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ABSTIIACT 



The Observational Chec kli sts fo r Referra l (OCR) were developed 
to assist teachers of young children in identifying problems that 
interfere with learning, making appropriate referrals to other pro- 
fessionals, and communicating with parents and professionals. The 
OCR includes a teacher manual, a General Checklist to be completed 
for each child, and Specific Checklists for the areas of Health, 
Vision, Hearing, Speech and Language, Notor, and Behavior. Specific 
checklists are to be completed only for children identlCied on the 
General Checklist. 

This technical report on development of the OCR includes summa- 
ries of ^.xternal consultant critiques, formative evaluation reports 
froDi users, and statistical cinalyses of data obtained from tv;o 
validation studies as well as recommendations regarding use and 
further development . 

The OCR haEJ been pilot tested by Head Start, Day Care, and 
public school teachers and has been reviewed by a team of external 
consultants representing the fields of Speech Pathology, Audiology, 
Early Childhood, Special Education, and Psychology. Research studies 
comparir.g teacher-administered OCR results v/ith screening evaluations 
performed by SEDL staff and external specialists (clinical child 
psychologist, educational diagnostician, speech pathologist, audi- 
ologist, pediat . ician , optometrist, and nurses) have been conducted. 
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PREFACE 



The ObsGi'vatignal Checlclists foi' Referral were developed as a port 
of the Ability Development Program under a grant from the Bureau of 
Education for the Handicapped. The Ability Development Program is 
designed to develop and test materials and procedures for: (1) iden- 
tificcition of young children with mild to moderate problems affecting 
learning, and (2) supplementary instruction to help the identified 
children progress at a level commensurate with that of their peers. 
Teacher training materials and workshops, classroom curriculum, and 
materials for parents are under development as a part of this project. 

The Ob servational Checklists for Referral (OCR) were developed to 
assist teachers and assistant teachers in identifying young children 
who have problems that may interfere with learning. In addition, the 
OCR is designed to enable teachers to make appropriate referrals to 
other professionals and to more precisely and objectively describe 
observations made. 

Project staff who have assisted in the development of the OCR 
include the following: Deborah Acevedo, Libby Doggett, Susana Hammett, 
Julia Niohaus, Claire Price, Alan Seitel, Sherry Young, and Becky 
Zuniga. Dr. Jerome Schmidt had primary responsibility for data analysis 
and preuaration of the technical section of this report. 

Sites participating in the testing of the OCR included Child, 
Incorporated, Ruth Hernandez, Program Director, Mary Leonard, Health 
Services Coordinator; A-Bar-Z Ponderosa Day Care Center, Vera Hooper, 
Director; and Edgev;cod Independent School District, Ciomara Rodriguez, 
Kindergarten Supervisor. 

The followiag consultants reviewed and critiqued the manual and 
checklists: 

Natalie Barraga, Ph.D., The University of Texas at Austin, Austin, 
Texas 

JoAnn Braddy, M.A. , ARBAC, Dardenella, Arkansas 

Dick Calkins, Ph.D., The University of Texas at Austin, Austin, Texas 
Margaret Emswiler, M.A. , Regional Office, HEW, Dallas, Texas 
Ernest Cotts, Ph.D., The University of Texas at Dallas, Dallas, Texas 
Linda Gotts, Ph.D., Mental Health-Mental Retardation Center, Austin, 
Texas 

Cherry Kugle, M.A., The University of Texas, R&D Center, Austin, Texas 
Frederick Martin, Ph.D., The University of Texas at Austin, Austin, 
Texas 

Joy Roye, M.A., Kibais Community Action, Stigler, Oklahoma 

Mary Lovey Wood, M.A. , Austin Speech and Hearing Clinic, Austin, Texas 

llie following external consultants conducted examinations of the 
children participating in the validation studies: 
Terry Furgiuele, M.D., Brackenridge Hospital, Austin, Texas 
Sarah E. LeDoux, Pediatric R.N., School of Nursing, The University of 

Texas at Austin, Austin, Texas 

iv 



Alice Richardson, Speech and Hearing Clinic, The University of Texas 

at Austin, Austin, Texas 
Diantha Scheffler, Department of Special Education, The University of 

Texas at Austin, Austin, Texas 
Martha Wofford> Speech and Hearing Clinic, The University of Texas at 

Austin, Austin, Texas 
Elena Cano Luderus, Ph.D., San Antonio Children's Center, San Antonio, 

Texas 

Mark Hutson, O.D., Austin, Texas 
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INTRODUCTION 



The Observa tional Checklists Tor Refarr al (OCR) were developed to 
assist teachers and assistant teachers in identifying ai^d referring 
children in need of more intensive examination or evaluation by other 
professionals. The OCR has been developed as part of t\jo projects 
funded by the Bureau of Education for the Handicapped ("A Project To 
Develop Curriculum for Four-Yo.ar-Old Handicapped Mexicr.n American 
Children," Grant No. OEG-0-74-0550 and "The Ability Development Pro- 
ject for Five-Year-olds/' Grant No. G0O75O0592). Initial development 
was conducted primarily with f our-year~old Mexican American children 
and later expanded to include Anglo and Black children between the 
ages of three and six years. 

In 1973, at the beginning of the first project, it became evident 
that teachers who had no previous training in special education or in 
identification of handicapping conditions needed a consistent and 
objective method of identifying problems of preschool children. Several 
checklists were collected from various sources and reviewed by the pro- 
ject staff. Most (jf the checklists were designed for older children, 
focused on only one area, or included technical terminology. Further, 
only limited inforniation on how to observe, refer, or follov; up was 
included. There was an obvious need for an interrelated set of check- 
lists, v/ritten in lay terms, which could be completed in a Biinin?.al 
amount of time by the classroom teacher. 

A preliminary set of checklists was developed by the project staff 
and tried out by six teachers and assistant teachers in three day care 
centers in Austin, Texas. Teacher feedback and staff observations 
provided the basis for a revision of the checklists and design of an 
initial version of the manual. In the spring of 197A, 10 teachers and 
assistant teachers completed the checklists, following ii. s tructions in 
the manual. The teachers and staff observers provided written feed- 
back. The manual and checlvl is ts were also reviewed by external con- 
sultants and/Ky a group of teachers enrolled in a course in child 
development at Austin Community College. The manual and cl^iecklists 
were revised on the basis of the information obtained. A report of 
this-^arlier development is included in a two-volume document. Fina l 
Report: A Pr ojec t To Develop Curriculum for Fou r -Year-Ol d H andicapped 
Mexican American Children (Evans, J. S., 1974) and is available through 
ERIC. 

The second version of tue OCR included an instructional manual 
for the teacher, a General Checklist to be completed for all children 
in the classroom, and six Specific Checl:lit:ts to be completed on all 
children identified on tlie General Checklist as having some difficulty. 

The OCR mnual includes specific, detailed instructions for com- 
pleting each checklis t, a general discuss ion of each Specific C-ecklis t 
and the problem area it is designed to identify, descriptions of 
common beh.avioral manifestations of those problems, and guidelines for 
making and following up referrals. Observational skills and techniques 
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arc explained, as well as descriptions of Llio specific behaviors the 
teachers should note in each child. 

Explanations and descriptions are v;ritten in nontechnical language 
for use by paraprof essional as v;ell as professional teachers of young 
children. Therefore, the language used throughout the manual is 
designed for the reader who has not had extensive training in special 
education, observational techniques, or screening procedures. 

The General Ciiecklist contains itez^.s which are designed for initial 
identification purposes. They are designed to cover, in broad terms.; 
common visible or behavioral symptoms of problems in young children. 
Each item on the General Checklist relates to one or more items on 
Specific Checklists. The Specific Checklists describe unusual behaviors 
or physical symptoms in greater detail. The Specific Checklists, when 
completed, can provide information about the child's classroom behavior, 
vjhlch leads to an appropriate referral for a more comprehensive evalua- 
tion by other professionals. 

/ As a part of the second project beginning in June 1975, the revised 
version of the OCR manual and checklists was tried out by teachers and 
assistant teachers in Riverside Day Care Center, Austin, Texas, and by 
public school kindergarten teachers in Edgewood Independent School 
District, San Antonio, Texas. A pilot validation study was conducted 
in Austin, Texas in an effort to determine the feasibility of conducting 
a more extensive validation study. The purpose of the study was to 
determine the number of over- and under-ref errals (false positives and 
false negatives) by comparing teacher-administered OCR results with 
screening evaluations by external consultants (clinical child psychol- 
ogist, pediatriciaa, educational diagnostician, speech therapists - 
Spanish and English, and nurses). Results of this study are reported 
in the following section, Validation Study T - 1975. 

The results of this validation study indicated that the usefulness 
of the OCR should be expanded for older and younger children, following 
revision and a more extensive validation study. T'ecdback obtained from 
the teachers, staff observations, and data from the pilot study provided 
the baris for a second revision of the manual and checklists. 

Follov;ing revision of the manual and checklists, a second valida- 
tion study was conducted at A-Bar-Z Ponderosa Day Care Center in Austin, 
Texas, during the summer of 1976. This center v;as selected for the 
study because there was a wide age range among the children and both 
middle-income and low-income children were enrolled. This study 
included 126 children ranging in age from 29 to 89 months .(mean age - 
56.35 months). Results of teacher-completed checklists were compared 
with professional examinations by a pediatric nurse, audioJ.o gis t , 
speech pathologist, psychologist, and educational diagnostician. In 
order to determine which of the checklist items most accurately iden- 
tified children found by the professional evaluators to have the problems 
indicated, the data v/ere subjected to a discriminant an'llysj^;, Results 
of this study are reported in the following section, Vaiidati.on Study 
II - 1976. 

2 
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The OCR has been revised on the basis of reviews by external con- 
sultants, user feedback, and the results of the two validation studies. 
In the following; sections of this technical report, the results of 
reviews by external consultants are suaunarized with more detailed 
information included in Appendices A and B. User feedback or infcrina- 
tion provided by teachers is described in the following section. This 
is followed by data from the two validation studies. 

The major goal in developing the OCR was tc produce a written 
instrument which would assist teachers in accurately identifying 
children in need of referral for more extensive evaluation and which 
placed minimal reliance upon specialized training of the teachers. A 
comparison of the results of the two validation studies indicates that 
a training session with teachers prior to using the OCR does increase 
the accuracy of identification.* However-, even without 'training, the 
rate.^of accurate identification Vs good and the rate of false negatives, 
(no problem identified when one does exist) is low. The rate of false 
negatives ranged from 4.3% :.9 19.2% with the higher rates being for 
questionable problems such as visual problems of muscle imbalance and 
health problems of umbilical hernia. The positive responses by the 
teachers and assistant teachers using the OCR, none of whom had pre- 
vious training in identification of existing or potentially handicapping 
conditions, clearly indicate the usability of the OCR by teachers of 
young children. 
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VALIDATION STUDlJiS 



initial denisn of tihc Obscrva t:.i.on al Chccklii^ts for Rafcrral (OCR) 
be^;an in the fall of 1973 and the first validation studLo:^ occurred 
in the spring of 1975. Throu[*]i a nerios of studies, reviev; and r^ivi s i on^i , 
cidequate levels of content, criterion-related, and constrnct validity 
have been demonstrated. 

During the initial design and development, establ ir.hinp, content 
validity was of primary concern order to insure tluit the checklist 
itcms~\/are relevant and coiiiprehe|isive . The content validity has been 
reassessed throughout the development ox. the OCR. 

As development progressed, it becanie vital to demonstrate tlie 
criterion- related valid ity of the instrument. That is, it \/as important 
to"~desc'ribe the degree of relationship between the checklist results and 
professional examiner evaluations of the children. Studies conducted 
by the project staff have sliown that the criterion-related validity has 
been enhanced in the latest versions of thot OCR. 

Establishing the cons tru ct validity of the OCR v;as the focus of 
studies completed in the fall of 1976. Statistical techniques were 
employed to deteriiiine the degree to v/hich certain constructs account 
for the observations obtained using the OCR. The results of tliese 
analyses indicate an adequate degree of construct validity. 

Studies, of the OCR have been conducted continually since the initial 
phases of development. The purpose of these studies has been to provide 
data on the validity ol the instrument and to identify tliose parts of 
the instrument needing further revision. These validity studies have 
varied in method and scope, yet each has provided the data necessary 
to demonstrate some facet of the usefulness and pertinence of the instru- 
ment in identifying debilitating problems of childT*on. 
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Content Validity 



"Content validity is demonstrated by showing how well the content 
of the' test samples the class situations or subjact matter about which 
conclusions are to be drawn" (Standards for Educational and Psycholo^^- 
ical Tests and Manuals, 1966, p. 12). In the case of the OCR, content 
validity was assured by the method of item selection, external consult- 
ant reviev;, and user feedback. 

Initially, content validity was enhanced by i eviev/ing and selecting 
items from existing checklists develuped by agencies concerned with 
specific areas of disability, such as indicants of visual problems 
listed by the Optome'cric Association. An item pool for each checklist 
was developed, comprised of items from existing checklists, recommen- 
dations by teachers and special educators, and from literature relevant 
to the six problem areas. The criteria used in selecting the items 
for use on the OCR checklists were as follows: (I) The item should 
describe deviant behavior in nontechnical terms; (2) The item should 
be developmentally related to the behavior of young children; (2) The 
item should be linguistically and culturally unbiased; (A) Each check- 
list should be composed of items that include common behavioral indica- 
tors of problems; (5) The items on each checklist should provide a 
comprehensive sampling of deviant beliaviors in that area, with limited 
overlap between items. The checklists were then compiled on the has Li> 
of the above criteria. 

Consultants, selected on the basis of their expertise in the areas 
covered by the OCR, were employed to evaluate the comprehensiveness; of 
each checklist and the adequacy of each item relative to the purpose 
of the instrument. The first consultant critique was conducted in the 
fall of 1974. This initial external review of the OCR was generally 
favorable and also provided recozunendations for change or clarifica- 
tion. In the spring of 1976, a major review of the manual and of the 
checklist was performed by eight external consultants. Each reviewer 
was requested to respond to specific questions related to the entire. 
OCR and to carefully critique specific sections of the OCR, These 
reviews were very positive. The few recommendations for changes in 
the manual were incorporated in the revision. The results of these 
reviews are included in Appendix C. 

A critique to determine item relevance and reading clarity was 
performed by a group of 10 experienced preschool teachers during the 
spring of 1975, Those teachers were selected because they were 
representative of the targeted user. Their critique of the OCR was 
most favorable and indicated that the earlier revisionj; of the check- 
lists had resulted in a more p^recise and thorough instrMinent. 

User feedback has provided an<i1?hiQ^' measure of contcn: validity of- 
the OCR. Since the fall of 197A, written and oral feedback has been 
gathered from more than AO classroom teachers who have used the OCR. 
The most recent feedback (1976) h;!S confirmed the appropriateness and 



relevance of the checklist items in describing the problem areas. It 
is apparent that user feedback has become more favorable with each 
revision of the OCR. 
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CritiGrion-related Validity 



^'Criterion-related validity is demonstrated by comparing the test 
scores with one or more external variables considered to provide a 
direct ineasure of the characteristic or behavior in question" (Standards 
for Educational and Psychological Tests and Manuals, 1966, p. 13). Two 
iTUijor studies have been undertaken to determine the criterion-related 
validity of the OCR. In both studies, teachers' ratings of students 
on the OCR were compared with actual examinations and ratings of the 
children by trained or qualified exaniiners. The purpose of these 
studies v/as to determine the extent to which teacher observations, basod 
on the OCR, agreed with the probler.s identified by expert examiners. 
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Construct V a lidit y 



Construct validity 1^^ determined by "the degree to which explanatory 
conceptf; or constructs account for performance on the test" (Standards 
for Educational and Psychologica] Tests and M:inuals, 1966, p. 13). In 
the case of the OCR, construct validity was determinad through the use 
of a Multiple Discriminant Analysin. This analysis determined the 
presence of checklist items and clusters of item.s that discriminate 
between the expert examiner ratings (1 through A). Therefore, since 
the examiner ratings indicate the presence or absence of problem areas, 
at least one of the items on each Checklist must discriminate between 
the examiner categories if tha OCR is actually identifying a child's 
problem. At least one significant root was found for each problem^: 
area. Thus the predicted results were found for all of the checklists, 
thereby establishing construct validity for each checklist in the OCR. 
It is not surprising that a high degree of construct validity was 
demonstrated for the OCR since the OCR data are objective observations 
of problem-related behavior. That is, since little inference is being 
made abou^ the child's condition, the OCR observations provide a direct 
and objective measure of the Construct in question. 

Content, Criterion-related and Construct Validity have been demon- 
strated for the checklists on the OCR. Studies, conducted over the last 
two years have demonstrated high levels of validity (construct, criterion- 
related and content) in all except the Motor area. These studies hrxve 
thereby sho\m that the OCR does perform the function for which it was 
designed. That is, it enables the observer t;o more precisely identify 
children who might be experiencing a deliilitating problem. 
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STUDY 1-1975 



The first study to determine the criterion-related validity of the 
OCR was conducted during December of 1975. The study included a total 
of 87 inale and female preschool subjects etirollcd in day-care centers 
in thp Austin area. Tlie children ranged in age from 76 to 37 months, 
with a mean age of 54.2 months. The subjects were Black and Mexican 
American children from low income backgrounds. The external ex-^miners 
were professionals in the areas of Clinical Child Psychology, Pediatrics, 
Educational Diagnostics, .'peech Pathology, aid Nursing; 

j Procedure 

Teachers and assistant teachers from four classrooms met with the 
project staff and received instructions regarding the purpose of the 
study and instrucions on completing the checklists. Assistant teachers 
were asked to assist the teachers in observing the children and con- 
tributing information. The OCR manual and the General Checklists for 
each child were given to the teachers at the coacJusion of the meeting. 
Approximately one week later, a project staff member met with the 
teachers individually to answer their questions, collect the General 
Checklists, and distribute Specific Checklists to be completed for 
children identified on the General Checklist. The com^jleted Specific 
Checklists were collected the following week and reviewed by the project 
staff. Throughout the time that the teachers w^ere completing the ' 
checklists, project staff members were continually available to respond 
to questions. 

The next step in the validation process was to verify the checklist 
information through individual examinations by professionals in each 
area covered on the OCR. For financial reasons it was not possible to 
have all the children checked by a professional in each of the areas. 
Therefore, different numbers of children were examined in each area. 

' The examiner ratings were compared V7jth the teacher rati-ngs on 

the OCR. The actual rate and percentage of agreement between the teacher 
.ratings on the OCR and the examiner ratings are portrayed in Table I 
Vor the areas of Behavior, Health, Hearing, Speech and Language, 
^,^tor, and Vision. The frequency of agreement between the OCR ratings 
s\ ows the number and percentage of children with a positive OCR rating 
(a problem identified by the teacher) who were also identified by the 
exii miner, that is, accur'ate positive identifications. The second column 
sha v^s the degree of agreement between the OCR r(:isults and the examiners' 
findings on children found to have no problems or accurate negative 
iden.f-.if ications . If identifications were 100% accurate, all children 
examined would fall into one of these two columns. Total accurate 
ident;,' f ications (correct positives correct negatives) are shown in 
columji. three. Thus the 1975 version of the '^R shows an accuracy of 
56.3% Vor the Health Checklist, "^2.7% for the Behavior Checklist, 77% 
for the' Speech and Languaj;o Checklist, and 75.9% for the Hearing 
Checklist. False positives (over-identification), or identifications 
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TABLE I 

Frequency and Percentage of Agreenient/Nonagreenient Between OCR and Examiner Observations 

1975 Validity Study 



CONFmiED IDENTIFICATION UNCONFIRMED IDENTIFICATION 



CHECKLIST 


OCR-POSITIVE 
EMINER- 
POSITIVE 


OCR-NEGATIVE 
EMINER- 
NEGATIVE 
h.ll 


TOTAL 
OCR-EXAMINER 
AGREEMT 
h.ll 


ocr-positive 
examiner- 
negative' 

No./Z . 


OCR-NEGATIVE 
EXAMINER- 
POSITIVE 
No. /7c 


TOTAL 
OCR-EXAI^INER 
NON-AGREEffiNT 

No. /I 


TOTAL ' 

h.ll 


Hearing 
u 


1 iiin 


37 imi 


kk M 


11:/ 19.0^ 


3 / 5.1'/ 


U /24.1/S 


58 /1007: 


ilpeech/Language 


12 llUl 





57 /77.0I 


8 /10.8^ 


1 

9 /12.17. 


17 /22.9Z 


n lim 


Behavior 


13 hill 


3 imi 


16 /72.7I 


1 / 4.67. 


5 /23.77 


6 /28.3J: 


22 /IOO7; 


Health 


6 llUl 


18 /37.5;» 


^ 

n, i%.ri 


4 /12.5I 


10 /31.2% 


1^ /43.72, 


38 iim 


Vision 


0 / 0 I 




85 /97.7'/ 


0/0 7. 


2 / 2.3;: 


2 / 2.37o 


87 iim 


Motor 

,..-„„, 


0/0 


a /85.9/i 


61 /85.9^ 


9 /12.7^ 


1 / Ut 


10 lu.n 


81 Iim 



by examiners which were not made by teachers using the OCR, arc shown in 
the fourth coluinn. False negatives (under-identif ication) , or identifi- 
cation of problenis by examiners which v;erc not identified by teachers, 
are shouTi in th^ fifth column. 

Hearing screenings were conducted with health aides under the 
direction of a nurse for 58 of the children. Portable audiometers v;ere 
used for the screenings which were conducted in an empty classroom. 
Because of external noise level, these screenings were performed at 
40 db. aciToss only three frequencies (500, 1,000, 4,000 Hz.). Data 
from the hearing screenings should be considered with caution as the 
testing conditions were less than ideal. On the basis of the data 
obtained, there was 75.9% agreement between the OCR results and the 
screenings, 19% over-referrals or false positives (11 children identi- 
fied on the checklist who passed the screening) and 5^1% under-ref errals 
or false negatives (3 children were not checked on the Hearing Checklist 
^^ho did not pass the screening) . 

Speech and Language screenings were conducted by a certified Speech 
Pathologist using the Goldman-Fr istoe Sounds in Words . A total of 74 
children were included in this exap.lnation . Of all the checklists, 
the Speech Checklist provided the highest rate of agreement between 
OCR results and screening by the examiner. Correct identification was 
77.0%, over-referrals (OCR Checklist positive, examiner rating negative) 
was 10.8% and under-ref errals (no checks on the Speech Checklist, 
positive identification of problems by the examiner) was 12.1%. 

Verification, of the Behavior Checklist required a more involved 
procedure. A Clinical Child Psychologist observed individual children 
in the classrooms at various times throughout the day. Each child 
was observed on at least- three occasions for a period of 30 minutes to 
one hour. This required several hours of observation and therefore it 
was not feasible to include all children. Thus, five children from 
each of the four classrooms were selected for intensive observations. 
In each classroom, four children were randomly selected from the group 
of children who had been checked on the OCR as having some type of 
problem, and one child was selected from the group of children checked 
as having no observable problem. The list of names was given to the 
psychologist who then observed the children. The psychologist had not 
seen the OCR manual or checklists and was not av/are of v;hich children 
had been identified by the teacher. The psychologist was asked to 
observe each child and to list those children with identifiable problems 
in need of special assistance. In the process of observation, the 
psychologist identified two additional children v;hose names were not 
included on the original list for observation. Thus, a total of 22 
children were observed. Tl^e total percentage of accurate identifica- 
tions was 72.7%; the percentage of over-referrals (identified by the 
teaclier but not by the psychologist)' was 4.6% (1 child), and five 
children or 23.7% v;ere not identified by the teacher but identified 
by the psychologist, thus constituting uader-ref erral . 

Health screenings were conducted by a pediatrician, following a 
form used by the day-care center (see Appendix E) . The pediatrician 
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had not seen the OCR manual or the HeaLth Cliecklist and v;as not. aware 
of Lhe ty[)e of inforination included. As for tiic ])ehavior screening's, 
iL vjas not economi call.y feasible for all children to be exainLned, 
Therefore, ten children who had been identified on the Health Check- 
list were scheduled for medical exaniinalions as well as ten children 
who had not been identified. The medical exanunations progressed more 
rapidly than had been anticipated and the physician liad time to 
examine additional children. Therefore, Llio decision was made to 
examine as many children as possible from Lhe Lv;o classrooms for 5- 
year-olds. This decision was based on the probiibility that tliese 
children Xs^ould be entering public school the following year and were 
most in need of medical screening. An additional 18 children were 
examined, bringing Lhe toLal number of children included to 38. 

Comparison of Lhe IlealLh Checklist identif icaLions wiLh the 
physician examinations was more complex than for Lhe oLher chccklisLs. 
The physician idenLified some problems which were noL related to Lhe 
checklist items, such as umbilical hernias or enlarged tonsils. In 
Lhe analysis of the data, these v:ere not considered as constituting an 
under- referral as teachers would noL be expected to examine for or 
recognize these problems. Of the ten under~re ferrals (OCRrnegative , 
Examiner-posiLive) , eight children had denLal caries vjliich v;ere 
identified by the physician but not observed by the teacher. The 
degree of severity was not defined and Leaclic-rs rarely noLice denLal 
caries luiless they are extremely severe. However, as Lhere is an 
item, "bad teetl/'y on Lhe HealLh ChecklisL, Lliis was considered an 
under-re ferral . Had Lhis single item not been considered an imder- 
referral, the rate of examiner-OCR agreement would have been much 
higher. 

The total number of accuraLe identifications was 56.3%, the 
number and percenLage of over-referrals (Health ChecklisL but no 
problem identified by Lhe pliysician) was 12.5% and the number of 
under-referrals (no HealLli Checklist ])ut problem identified by 
physician) was 31.2% 

Visual screenings were conducted for all Lhe children .by healLh 
aides working under the direction of a nurse. The Snellen K charL, a 
ir.'.asure of. distance acuity, was Lhe only measure used. None of Lhe 
children had been identified as having possible problems on the visual 
checklist, and only two children were identified by the examiner. 
This information was noL included in the analysis for several reasons. 
The data provided a false picture of the accuracy of the Visual Check- 
lisL; Lhat is, 85 of the 87 identifications were accurate — no check on 
the Visual Checklist and no idenLified problem, and only 2 of Lhe 87 
were possible under-identif 1 caL ions . This is misleading information 
as only distance vision was checked. Furthermore, tlie children Vs 
responses to the direcLion in which the sLimulus (K) faced were erraLic 
It was difficulL Lo deteoune wiu'thor th-j childrei;! undersLood Lhe^Lask. 

The daLa v/ere subjected Lo two LyjK'S of staListical analysis: Chi 
Square analysis (Table 11) and Po in L biserial correlation (Table 111). 
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TABLE II 
Chi Square and p Values for 
OCR and Examiner Agreement 
1975 Study 



CHI SQUARE 

CHECKLIST VALUE £ 



Speech/Language 


13.48 


.0001 


Hearing 


8.57 


.0001 


Behavior 


3.14 


.08 


Health 


.83 


.30 


Vision 


No analysis 
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TABLE III 

Correlation Coefficients and p Values for 
OCR Ratings and Examiner Ratings 
1975 Study 



CHECKLIST 


CORRELATION 
COEFFICIENT 


p VALUE 
..LESS THAN 


Speech/Language 


.610 


.01 


Hearing 


.591 


.01 


Behavior 


.524 


.01 


Health 


.670 


.01 


Vision 


.820 


.01 
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A 2 X 2 Contingency Chi Square analysis v:as pcrformo.d on the frequency 
of identification data for each i)roblcm area.' The results of those 
analyi^es are presented in Table II. As noted in Table II, the Chi 
Square values for the Speech and Hearing data v;ere significant, while • 
the X'^' value for the Behavior data approached but did not reach 
significance (P = .08). The analyses indicate a significant rate of 
agreement between the OCR results and the examiner evaluations on the 
Speech Checklist and the Hearing Checklist. The physician who con- 
ducted the health examinations included the identification of health- 
related problenu; outside the scope of the checklist (e.g., tubes in 
ears and immunizations not up to date). It is possible that significant 
results might have been found had the physician simply attempted to 
determine the presence of observable health-related problems. 

In order to describe the degree of relationship between the examiner 
ratings and the OCR results, a poin t-bis eri al correlation was performr-d 
on these data. The correlation coefficients for c^zh of the problem 
areas (Speech/Language, Hearing, Behavior, Health, and Vision) were 
found to be significant (P< .01). The correlation coefficients 
coupled with the nonsignificant Chi Square values, suggest that Dhe 
agreement between the OCR data and the examiner ratings in the Health 
and Behavior Areas occurred nri.iiaril.y in tiia extreme cases where rhe 
child received an examiner rating of /-l "Ko problem" or /^A "Definite 
problem." These findings indicate that the H-havLor an^ Health Check- 
lists are m.nre accurate i n di scr i m i.nat ing bet:v;een t hose cases at the 
extremes of the scale. 'I J ; conclusion is not surprising since the 
cases that fall in the mLildJ. range of the scale are by definition the 
more ambiguous problciins and thereby m.ore difficult for the teacher as 
v;ell as ttie exainLner to identify. 
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STUDY II - 19 76 



The OCR manual and checklislis were extensively revised following 
the previous study, in an effort to improve the accuracy of the OCR. 
A second study was conducted during June, 1976 to assess thu validity . 
of the revised OCR with a wider age range of children from different 
socioeconomic backgrounds than those sampled in the 1975 study. This 
study included 126 subjects (63 male and 63 female) ranging in age 
from 29 to 89 months (X = 56.4 months; S. D. = 13. A months), attending 
a private day t-: e center in Austin, Texas. Thirty-one of the subjects 
were Black anu ncxican American children from low^ income families, 
and the remainder were children from middle-income families. 

The same basic procedure was followed in this study as in the 1975 
study. The external examiners v;ere professionals in the areas of 
Speech Pathology, Audiology, Nursing, Educational Psychology and 
Diagnostics, and Optometry. In this study, data from the vision 
screening were included in the analysis as a more comprehensive screen- 
ing was performed. Viowever, data from the motor screening were not 
included in tlie data analyses, since once again, too few children were 
identified in this aroa. 



Teachers from si>: classrooms net briefly with the project director 
to receive instructions regarding the purpose of the study. As a 
secondary purpose of this study was to determine the effectiveness of 
the OCR when used without project staff instructions or direction, the 
teachers were asked to read the manual and discuss it with each other 
prior to completing the checklists. Each teacher was given a complete 
set of checklists (General plus each Specific Checklist) for all the 
children in each classroom. No further instructions wer'^ given and 
the checklists were collected at the end of one week. 

Follov;ing collection of the checklists, individual examinations 
were performed by professional experts in each area cohered in the OCR. 
Although tlie examinations were more extensive than thb"se performed in 
the previous study and more children were included, it was not financially 
feasible to have all of the children examined. .Therefore, different 



numbers of children were examined in eath area. 

Criterion-related validity for each checklist was determined by 
comparing the examiner ratings v;ith OCR ratings by the te^chers. The 
actual numbers and percentages of agreement between the teacher ratings 
on the OCR and the examine^r ratings are sho\vm in Table IV for the areas 
of Hearing, Speech and Language, Behavior, Health, and Vision. The 
frequency of agreement betv;een the OCR ra Lings and the examiner 
ratings are shown in each column. The first column shows tlie number 
and percentage of children with a positive OCR rating (a problem iden- 
tified by the teacher) who were also identified by the examiner — that 
is, acQAiirate positive iden tif iCcitions . The second column portrays the 
degree agreement between -the OCR re.sults and the examiners findings 
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> TABLE IV 

Frequency and Percentage of Agreeroent/Nonagreement Between OCR and Examiner Observations 

1976 Validity Study 



CONFIMD IDENTIFICATION L'NCONFMD IDENTIFICATION 



CHECKLIST 


OCR-POSITIVE 
EXAMINER- 
POSITIVE 
No.//: 


OCR-NEGATIVE 
EMJIINER- 
NEGATIVE 
No./Z 


TOTAL 
OCR-EXAMINER 
AGREEMENT 
No./7. 


OCR-POSITIVE 
EXAMINER- 
■ NEGATIVE 


OCR-NEGATIVE 
EXAMINER- 
POSITI\Ti 
No./^: 


TOTAL 
OCR-EXAl'IINER 
NON-AGREEMENT 
No./^ 


TOTAL 
No./?o 


Hearing 


13 /71.8'/ 


66 /60.0X 


79 IllM 


25 /22.7;: 


6 / 5.5^ 


31 /28.2'Z 


110 \mi 


Speech/Language 


14 lUM 


51 I51M 


65 /65.0% 

i 


21 /21.0Z 


, 

14 /14.0^ 


35 /35.0/: 


! 

100 \mi\ 


Behavior 


11 /23.9X 


r 

16 lll^.ll 


27 /58.6Z 


17 /36.9Z 


2 / 4.3/: 


19 /41.2/; 


. j 

46 /lOOZ, 

) 


Health 


10 in,n 


\ 

11 /32.97o 


37 Ik5.ll 


35 /42.7Z 


10 wi.n 


45 /54.95: 


82 \mi 


Vision 


8 /30.87. 

■ 


10 /33.6'/ 


18 imi 


3 /II. 6^ 

1 


5 /19.2;^ 


8 /30.8:^ 


26 /lOOZ 
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on chi -ir^n found to have no .• or accurate negative identifi- 

catiors. Total accurate idem, .cations (correct positives + ^orrect 
neuati . -s-) arc sho^m in column three. Thus the 1976 version of the OCR 
shows .n .-.ccuracy of 1^5.1% for the Health Checklist, 58.6% for the 
Bchav'or Checklist, 65.0% for the Speech and Language Checklist, and 
71 82 for the Hearing Checklist. False positives (over-idr.ntif ication; , 
or'ideu-ifications by examiners which vere not made by teachers usinf; 
the OCR, arc sho^m in the fourth colu^.m. False negatives (under-idon- 
tification), or identification of problems by examiners which were not 
identified by teachers, are sho\m in the fifth column. 

Hearing screenings were conducted for 110 children by a certified 
audiologist in an isolated, carpeted room. The equipment utilized m 
the screening procedure included a Beltone 10-D portable audiometer. 
The electroacoustic pathway terminated in a matched pair of TDH-39 
receivers mounted in MX-41Ail cushions. The stimulus was demonstrated 
for each child before the headset was placed on the child s head. A 
100 db FTL (AlJSl) 2000 Hz pure tone was introduced as the child 
listened, and the examiner noted that the tone wa^ heard. When the 
child also indicated that the tone was heard, the headset was placed 
on his or her head and the final instructions were given. These^^ 
instructions were ta-raise a hand every time a 

was heard The children were then tested using a 25 db . HTL (.AMbi; 
pure tones ranging in frequency from 500 Uz through 8000 Hz. Th^re 
was 71 8% agreement between the OCR results and the screenings, 22.7 A 
over-referralo or false positives (25 -children identified on the . 
checklist who passed the screening) and 5.5% under-ref errals or false 
negatives (6 children were not checked on the Hearing Checklist who 
did not pass the screening). 

Speech and Language Screenings were conducted by a certified Speech 
Pathologist following a screening survey form used xn the Department of 
Speech Pathology and Audiology at The University of Texas at Austin 
(see Appendix F) . A total of 100 children were included m this 
examination. The screening took from .five to fifteen minutes per child. 
The procedures used varied according to the age level of the child 
and included having the children name pictures, repeat sentences, tell 
stories, provide information about themselves (name, age, sex, birthday, 
etc ), count, identify colors, identify body parts, repeat digits, 
blend sounds auditorily, answer wh- questions, etc. Oral peripheral 
examinations were performed and spontaneous speech was elicited from 
each child. Correct identification was 65.0%, over-referrals (OCR 
Checklist- positive, examiner rating negative) was 21.0% and under- 
ref errals (no checks on the Speech Checklist, positive identification 
of problems by the examiner) was 14.0%. 

Again, verification of the Behavior Checklist required a more 
involved procedure. An educational diagnostician with advanced degrees 
in Early Childhood, Special Education, observed individual children in 
the classrooms at various times throughout the day. Each child was 
observed on at least two occasions for a period of 30 minutes to one 
hour. This required several hours of observation and therefore it was 
not Jeasible to include all children. From each of five classrooms. 
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10 children v;cre scileclctl by the project, staff for observa tiion , V/Lth- 
in each classroom, five chi.Idron v/ere selected from those who had been 
identified by the teacher on the Behavior Checklist, and f7ve children 
v;hc) had not been identified v^ere selecced. The list of names was given 
to the examiner who then observed the children during free play, inde- 
pendent and group activities. The exardner was not able to observe all 
the listed children due to time limitations, therefore data were avail- 
able for only A6 childrf*n. The percentage of accurate identifications 
was 58.6%; the percentage of over-re ft.rrals (identified by the teacher* 
but not by the examiner) was 36.97,; and t\:o children, or 4.3%, were not 
identified by the teacher but were identified by the examiner, thus 
constituting under-ref errals . A number of the over-referrals occurred 
in the three-year-old c la sr. room in which the teacher had identified 
crying as a major problem. 

Health screenings were conducted by a registered pediatric nurse, 
following a form used in training public school nurses. The nurse 
had not seen the OCR manual or Health Checklist and was not av;are of 
the type of information included. As for the Behavior screenings, 
it was not economically feasible for all children to be examined. The 
45 children checked on the Health Checklist as v;ell a'^ 37 additional 
children v/ere screcmed for physical probleir^s. A total of 82 children 
w^ere screened for health problems. Again, comparison of the Health 
Checklist identifications with the physical examinations .was more cora- 
plex than for the other checklists. Tiie nurst: examined eacli child for 
diseases of the eyes, cars, nose, throat, heart, and lungs, as well as 
observing the child while v;alking, hopping, jumping, and dressing and 
undressing. Several ])roblems not directly related to the checklist 
items, such as tubes in the ears, were identified. This was included 
on the data analysis, however, as this can constitute a problem. (This 
also indicated a definite need for addition to tlic Health Checklist of 
pertinent medical information affecting the child's activities.) The 
total number of accurate identifications v;as 37 or 45.1%. The under- 
reforrals were 12.2% (primarily ear- tubes), and over-referrals were 
42.7%. 

Vision screenings were conducted by an op tOTrie tr is t for 26 children. 
All children (N=ll) who had been identified on the Visual Checklist were 
included as v;ell as children selected at random from among those v;ho had 
not been identified on the Visual Checklist. The optometrist used cither 
the Snellen E chart or a picture cliart, depending upon the age and 
responsiveness of the children, and checked for L.i:scle imbalance and 
eye dLijease. Correct identification or agreeinent between Checklist 
results pnc\ optometrist screenings occurred in 68.6% of the comparisons. 
There v;ere 3 over-referrals (Checklist positive, examination negative) and 
5 or 19.2% under-ref errals (Checklist negative, examination positive). 

The data were subjected to two rypes of statistical analysis: Chi 
Square (Table V) and Point Biserial correlation (Table VI). Tivto by Two 
Contingency Chi Square analyses were performed on these data (Table V). 
These analyses resulted in significant Chi Square values for the areas 
of Hearing, S])eech, and Beiiavior, The value for the vision data 
approached but did not reach significance (P< .07), It was noted that 
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TABLE V 
Chi Square and p Values for 
OCR and Examiner Agreement 
1976 Validation Study 



CHECKLIST 


CHI SQUARE 
VALUE 


P 


Behavior 


4.29 


.03 


Hearing 


11.66 


. 0001 


Health 


.254 ns 


.70 


Speech/Language 


3.85 


.05 


Vision 


3.09 


.07 
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TABLE VI 

Correlation Coefficients and p Values for 
QCR Findings and Examiner Ratings 
1976 Validation Study 



CHECKLIST 



CORRELATION 
COEFFICIENT 



p VALUE 
LESS THAN 



Behavior 


.515 


.01 


Hearing 


.584 


.01 


Health 


.507 


.01 


Speech /Language 


.623 


.01 


Vision 


.632 


.01 
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in the Health area the examiner identified irralevant problem areas 
(e.g., tubes in ears). Again, had the exai iOr focused only on health 
problems as related to the condition of the child at the time of 
examination, the results might have been significant. Overall, the 
find.ings of these analyses Indicate a significant rate of agreement 
between the teacher evaluations using the OCR and the opinions of the 
expert evaluators, in identifying childrer vJ'h speech, hearing, or 
behavior problems. The rate of agreement for vision problems was high 
but nonsignificant. 

Further analyses were employed to determine the degree of agreement 
between the OCR results and the examiners' ratings. Point biserial 
correlations were performed on the data in the areas of speech, hearing, 
behavior, and health. These analyses resulted in correlation coeffi- 
cients ranging from .51 (Health) to .63 (Vision) . All of the correlation 
coefficients were significant at the P < . 01 level. These analyses 
indicate that -the rate and degree of agreement of the OCR results with 
expert ratings is significant for the Speech, Hearing, Behavior, Vision, 
and Health Checklists. These findings establish a high degree of 
Criterion-Related validity for the Vision, Speech, Hearing, and Behavior 
Checklists. Once again, the significant correlatior^ coefficient found 
in the Health and Vision areas coupled with nonsignificant values 
suggests that the Health and Vision Checklists are more accurate in 
discriminating those cases at the extremes of the raters' scale (i.e., 
irl "No problem" and //4 "Definite problem." Overall, the results 
indicate that improvements in accuracy of prediction have been made 
over the 1975 version of the OCR and that a moderate to high degree of 
Criterion-Related validity has been established for the entire checlclist. 
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STUDY 1 AND II - COffARISONS 



A comparison of the results of the 1975 and 1976 Criterion-related 
validity studies indicates a higher rate of OCR-Examiner agreement in 
some areas on the more recent study and a lower rate in other areas. 
There seem to be several plausible reasons for these unexpected findings. 
First, in the 1975 study, the teachers were trained in the use of the 
OCR and in the identification of problems in children. In the 1976 
study, the teachers were simply given the OCR manual and asked to read it. 
The training provided in the earlier study may have outweighed the 
deficiencies in the earlier version of the OCR, thereby increasing the 
accuracy of identification. Secondly, the examiner screenings in the 
areas of hearing and vision were more stringent in the 1976 study. In 
the 1975 study the vision and hearing screenings w^ere conducted by 
paraprof essionals using relatively crude methods and instruments, whereas 
the screenings in the 1976 study v;ero conducted by an Audiologist and an 
Optometrist. The examinations by the professionals were more compre- 
hensive and more thorough than those conducted in the 1975 study. 
Finally, the screening conducted to identify social/emotional problems 
in the 1975 study also included the identification of learning problems. 
Following this study, the Behavior Checklist was divided into two 
separate checklists- to identify behavioral and learning problems. In 
general it seems as thoug^ the 1976 study was a more realistic use of 
the OCR and employed more stringent methods in confirming the teacher 
observations than were employed in the 1975 study. 



RECOMMENDATIONS FOR FUTURE RESEARCH AlviD DEVKLOPMENT 



Several areas for future study have grown out of the validation 
research on the OCR. Is^ile past research on the OCR has confirmed 
its usefulness in identifying young children in need of referral for 
specialized examination or testing, it has also provoked questions con- 
cerning its applicability to older children and ways to enhance its 
accuracy in identifying problem areas. 

One important question that has not been addressed is: Do teachers 
who use the OCR make more appropriate and accurate referrals than teachers • 
who do not use the OCR? Based upon previous experience of the project 
staff and the examiners, teacher referrals are frequently ambiguous 
statements such as " , , , is alv/ays getting in trouble" or "...doesn^t 
try." However, research is needed to clearly determine whether more 
accurate and specific identifications are obtained when using the 
OCR. Another variable that may enhance the accuracy of referrals is 
the training provided in addition to reading the manual and using the 
checklists. It might be determined that a trained observer Anakes more 
accurate referrals than does an untrained observer. Thus in using the 
variables of no training, training for general 'observation,] training for 
observation using the OCR, and use of the OCR with no training, the 
effectiveness of training with the OCR could be more clearly determined. 

Another possibility for future research would be a comparison of 
parent observations versus teacher observations using the OCR. This 
would simply be an^expansion of the past criterion-related validity 
studies on the OCR. It might be determined that accuracy of referral 
can be enhanced by using one or both sets (Pi^rent and Teacher of 
observations .) 

Another possibility for future study of the OCR would be to evaluate 
the relevance of the OCR to older children. The purpose of this study 
would be to simply determine the age range where the OCR observations 
are most appropriate. Conversely, it would be determined at what age 
the observations are no longer relevant. 

It is apparent that a number of studies could be conducted on the 
OCR. However, at this time it seens to be more relevant to answer 
questions concerning the expanded use of the instrument, and ways in 
v;hich the accuracy of the OCR can be further increased. 



coNSULTiVirr reviev/s 



External consultants reviewed the OCK inanual and checklists 
during May and June of 1976. Five consultants were selected on the 
basis of their particular areas of expertise as related to specific 
sections of the OCR, and two reviewers were selected because of their 
experience in rural areas outside of Texas. Following an explanation 
of the review task, a letter, the manual and checklists, and review 
instructions were mailed to each consultant. A copy of the letter and 
the review instructions are included in Appendix B. 

Consultants participating in this phase of development and their 
particular emphasis areas were- 

1. Dr. Ernest Gotts, Department of Special Education, University 
of Texas, Dallas, Texas, who reviewed the manual and checklists 
for overall applicability to young children. 

2. Dr. Natalie Barraga, Department of Special Education, Univer- 
sity of Texas, Austin, Texas, who reviewed the manual and 
checklists with particular emphasis on visual sections. 

3. Dr. Frederick Martin, Department of Speech Communication, 
University of Texas, Austin, Texas, who reviewed the manual 
and checklists with particular emphasis on the auditory 
section. 



4. Dr. Mary Lovey Wood, Austin Speech and Language and Hearing 
Center, Austin, Texas, who reviewed speech sections of the 
manual and checklists- 

5. Dr. Linda Gotts, Austin Mental Health/Mental Retardation 
Center, Austin, Texas, who reviewed the manual and checklists 
with particular emphasis on the social/emotional sections. 

6. Ms. JoAnn Braddy, ARBAC, Box 248, Dardenella, Arkansas, who 
reviewed the manual and checklists v;ith particular emphasis 
on the applicability of the OCR to rural areas. 

7. Ms. Joy Roye, Kibais Community Action Foundation, Box 473, 
Stigler, Oklahoma, who reviev/ed the manual and checklists 
with particular emphasis on the applicability of the OCR to 
rural areas . 



In addition, Ms. Margaret Emswiler, Child Development and Educa- 
tion Specialist, Department of Health, Education and Welfare, Regional 
Office, also reviewed the OCR and added suggestions on the manual. 

Reviewers were requested to provide v;ritten reports in response 
to the following areas: 

1. Suggestions for modifications to the instructional manual. 



2. Specific suggestions for additions and/or deletions to the 
General Checklist whica v;ould provide for more accurate 
referral to the appropriate Specific Checklist. 

3. Specific suggestions for additions and/or deletion-; lo the 
Specific Checklists vliich vrould enhance the probability of 
accurate identification of children having difficulty. 

A. Any suggestions which might serve to limit the over- and 
under~ref erral rate. 

5. A general statement of assessment of specific parts of the 
OCR and of the measure as a whole. This includes assessment 
of the need for such a measure and its usefulness ' in aiding 
teachers in communicating with professionals in providiilg 
referral information. 

6. Evaluation of the clarity and readability of the manual as a 
whole . 

7. Any additional suggestions for revision. 

The complete written reports from all consultants are included in 
Appendix C. In several cases, the consultants also wrote in the OCR 
manual. This information has not been reproduced, but is, available 
from SEDL. Responses to items 1 through A and item 7 were reviewed 
and incorporated into the revised version of the OCR, 

Items 5 and 6 provided informtion on the overall value of the 
OCR. General comments regarding the usability of the OCR and recom- 
mendations for further development, compiled and summarized from the 
complete reviews for ease of reading, follow. 



1. Dr, Ernest Gotts 



I am really pleased to see the excellent job of putting to- 
gether you have dene on the OCR.,. (Memo, Page 1) 

..,Even the field of special education v/here teachers are 
supposed to be highly trained and so forth, seems to skimp 
on preparing teachers to look for signs of problems. This 
type of material could be used by a resource or helping 
teacher to train classroom teachers in early childhood to 
refer in potential problems. The instructions for the OCR 
could be stronger in encouraging teachers to insist' on 
recommendations that are relevant for classroom activities 
and specific enough to be implemented... (Item 5, E. G. Review) 

2, Dr. Natalie Barraga 

Overall, the OCR should be a very useful tool for teachers of 
all young children, especially those who have less sophisti- 
cated preparation, or those who really do not know what is 
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normal or unusual In a child's behavior. There is a definite 
need for such a measure for day care centers, Head Start 
programs, Early Childhood Education Programs, and even pri- 
maVy teachers in the public schools. My experience indi- 
cate-, that unless workers and teachers have had some special 
cducxition training, many simply do not know that certain 
behaviors indicate any type of problem or do not think about 
anything wrong... Just having the medical terms explained in 
understandable language will make teachers more comfortable 
and more willing to make referrals. (Item 5, N.B. Review) 

3. Dr. Frederick Martin 

In my opinion, this is a well-done pamphlet. Publications 
of thig sort are often overly technical and disinterest the 
very persons they are trying to reach. You have struck a 
balance between brevity and detail w.i th no major sacrifice 
in accuracy, although I am certain that there are Purists 
from each special are.-, who rilght groan at the oversimplifi- 
cations (Cover letter, page 1, F. M. Review). 

As implied earlier, my general impression of the OCR is 
favorable... The manual is generally clear and well written. 
(Cover letter, page 2, response to items 5 and 6, F. M, . 
Review) 

A, Dr. Mary Lovey V/ood 

I am very impressed with the OCR and with the exception of 
those suggestions I have listed, I have no changes. I would 
like a chance to see a follow up study after this has been 
in effect for a year (Item 5, M.L.W. Review). 

5. Dr. Linda Gotts 

As a result of consultation with various preschools in the 
Austin area, I see a definite need for a measure such as the 
OCR which can be used by teachers to identify children who 
could benefit from special help before they begin to fail in 
schoo'. Ir IS important, of course, to do this without the 
stigma of labels, which the OCR successfully manages to avoid. 

Th-- information on the checklists should be useful and rele-' 
vant to the professionals to whom the teachers are referring 
children. Also, the checklist format provides significant 
information quickly and is more likely to be read by busy 
professionals than lengthy written reports. 

The ideas in the OCR seem .o have been carefully thought out, 
with the important points emphasized and repeated throughout. 
There is sufficient detail on the checklists to be helpful 
but not so much detail that the teacher trying to fill them 
out will be overwhelmed. 
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The instructions for each checklist do an adequate job of 
explaining the various areas covered in the checklist, so 
that any confusion arising over specific items would usually 
be clarified by referring to the instructions. In general, 
the items selected for each specific checklist do a good 
job of covering the pertinent behaviors or symptoms for that 
problem area. In short the OCR seems to me to be fairly well 
polished in its present form. 

Ms. JoAnn Braddy 

The measure seems excellent to me. I would be anxious for 
this to be used in my program. There is without question a 
need for such a measure. I particularly like the explanation 
prior to the specific checklists. It appears to be written 
in terms that nonprofessional staff could use the measures. 
I feel very, very positive toward the measures. 

Ms. Joy Roye 

From my experience of directing a Head Start program in a 
rural area I can stace err.phatically that there is a need to 
help teachars recognize the importance of observing indivi- 
dual children and communicate the appropriate information 
to professiona Is (Item 1, J.R. Review). 
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TEACHER FEEDBACK 



Teachers from A-Bar-Z Ponderosa Day Care Center and from River- 
side Day Care Center in Austin, Texas participated in a validation 
study of the OCR in June 1976, Each teacher read the manual and 
completed checklists for the children in her classroom. After the 
checklists had been completed, the teachers were asked to complete a 
feedback form on the manual and checklists (see Appendix C) , 

The first page of the feedback form provided space for the 
teachers to rate the checklists and manual on a, five-point descrip- 
tive scale. The following three pages provided space for individual 
responses to specific questions an^ suggestions for change. 

The nformation provided by teachers was used, in combination 
with reviews by external consultants and actual data obtained through 
the validation study, in making final revisions of the manual and 
checklists. As the manual and checklist are intended for use by the 
classroom teacher, all teacher suggestions were most carefully 
considered in making revisions. 

On the following pages, the actual teacher-ratings and verbiL-'jn* 
comments ere shown for the 15 tc * .rs who returned the forms. 
Responses were not given to some of the questions, and some of the 
checklists were not used by" some teachers. 
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FEEDBACK DATA 



User ratings of the checklists 



:HECKLISTS Excellent Good Average Poor Useless 



General Checklist 


xxxxxxxx 


xxxxxx 


X 


Health Checklist 


KXXXXXX 


xxxxxxx 




Vision Checklist 


XXXXXXXXX 


XXX 


X 


Hearing Checklist 


xxx:cxxxxx 


XXXX 




Speech Checklist 


xxxxxxxx 


xxxx 




Behavior Checklist 


xxxxxxxx 


xxxxx 




Motor Checklist 


xxxxxxx 


xxxxx 




Ease of Administration 


xxxxxxx 


xxxxx 





User ratings of the manual 



MANUAL Excellent Good Average Poor Useless 



Introductory Chapter 


XX xxxxxxxx 


xxxxx 


Health Chapter 


xxxxxxxxx 


xxxx 


Vision Chapter 


xxxxxxxxx 


xxxx 


Hearing Chapter 


xxxxxxxxx 


XXX 


Speech Chapter 


xxxxxxx 


xxxx 


Behavior Chapter 


xxxxxxxxx 


XXX 


Motor Chapter 


xxxxxxx 


xxxx 
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USER COMMENTS 

\ 

Referra l Sections (Were sections on pages 11, 17, 22, 28, 37, and 43 

helpful?) \ 

\ 

-Explaining what kind of doctor helps the teacher talk to the 
parents. I think they were very clear and would help a teacher 
in the follow througli. 

-Yes 

-Reminded me of several important points. Ara sure it was helpful 
to parents. 

-Yes 

-OK 

-Yes 



General Rel iability : (Was tlie manual easy to read and understand?) 
-Yes 
-Yes 

-I found the inamiai readable, but I wondered whether or not the 
parents of Wli^ children would understand the explanations. Some 
of them are poor readers and would become frustrated at trying to 
read all the.v|ords.* 

('-This refers to the fact that a copy of the manual was given to 
the parents who indicated an interest in reviewing the manual 
and checklists. This was done in order to determine whether 
parents were interested in and the feasi:>ility of developing 
a parents version of the. OCR.) 

-Very Easy 

-It v;as easy to read, hut I felt I should read it the second 
time to really understand if. 

-Yes 
-Yes 
-OK 

41 

-OK 
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Illustrations: (Help toward understanding text; Contribution toward 
" format) 

-I think the illustrations were very helpful. It's easier to 
notice something wrong when you have seen it in a picture. 

-\gs 

( 

-Yes 

--Yes; I definitely feel illustrations should be included. They 
break up pages of explanations and attract your attention 
• immediately. Also, I think they are helpful for some parents. 

-OK 

-Very helpful 
-Yes 

Organization ; (Was manual clearly organized?) 

-Yes, a person could 'read one section at a time ar " do the 
proper things. 

-Yes 

-Yes 

-Yes 

-OK 



-Yes 



SuRRCStioris for chan^^e in either checklists or chapters: 



1. General 

/ 

/ -There needs to be more questions on vision. The question "seems 
to have trouble seeing" is too general. In a small child, it 
is hard to tell vision problems. 

-I was surprised to see nothing about a child's self-concept. 

-No changes 

-OK as is 



2. Health 

-Condition of hair? If there ar^-^ scars on the body and where? 

-I think frequency of bedwetting should be mentioned. Perhaps a 
space should be provided to record any medications being taken 
and/or operations such as adenoid, ear, eye, etc. 

3. Vision 

-No suggestions given by any user. 

4. Hearing 

-Maybe a quest: ion concerning a child r 
hands as soon as a record begins to p 

5. Speech 

-No suggestions given by any user. 

6. Soc ial/ Emotional 

-Maybe a question about. a child being overly possessive to the 
extent of hiding toys or dividing tlie toy into parts and hiding 
the parts in different locations, for example. 

-There was np mention of child's insecurity or sensitivity 
specifically. 

7. Motor 

-Since quite a few children wear corrective shoos while young, 
perhaps a r.Latcment about it could be included. 



'ing his ears with his 
or when sing-^ng. 
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Which section(s) was (were) most Luportant to you? 
-Health and Speech 
-Social/Emotional or Behavioral 
-Social/Emotional or Behavioral and Hearing 
-Behavioral and Health 
-Behavior and Health 
-Speech 
-Behavior 

-Hearing and Speech 

Which sectionCs) was (were) least important to you? 

-Fine motor is so new to some three year olds it is hard to tell 
if they are weak in that are-E. unless it is to an extreme. 

-Visual — I found it hard to evaluate. 

-They were all important. 

\^at other tests have you used to screen children for referral? 

-The teacher could recognize such things as tantrums, excessive 
crying, health probleins, speech problems, large motor problems, 
etc. These were discussed with the director and special plans 
wore made for that child, 

-None 

-None 

-General classroom observation 
-■.^'othing 

\Nni.at di<-l you like best about the checklists? 
-They were convenient to ue,e 
-V/ell worded and outlined 
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-After reading the specific checklist, I realized that perhaps 
some of the children might have belonged there. Maybe if X had 
used the specific checklists first, or along with the general 
list, I would have included some children more. I thought they 
didn't belong. 

-I was very impressed with it. It explained very many things that 
I was not aware of. It was easier for me to make out the check- 
lists. I had more things to look for that I didn't know whether 
I had really observed before. 

--The OCR is very helpful, clear, a\id seems to cover a large range 
of problems. The guide is most helpful. 

\^at did you like least about the manual? 

-Cannot think of anything I didn't like. 

-For parents, the vocabulary — too rach reading for some of them* 

-It looks difficult and long but it is not when you read it. You 
might stress this when giving out the checklists. 

-1 found it difficult to pinpoint things. 

-Nothing 

-None of it 

-Noth ing 

VJliat is your overall opinion of the OCR? 

-I like the manual and the checklists. I think it will be very 
helpful if used on a long term basis and with many children. I 
feel I hrxve been rushed in filling out the checklists. A teacher 
should spend at least a few days observing each child while she 
is filling out the checklist. 

-I'm glad we were fortunate enough to be able tc. do the OCR in our 
school. 1 know it makes me more aware of v;atching for certain 
things in the children and probably did the same thing for parents. 
I was thiilled to have the children's motor, sight, hearing, etc. 
abilities checked . 

-Generally very helpful, 1 feel tcacliers should have some group 
meeting at the beginning of ur>age in order to discuss it, 

-Very good 
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-Easy to read, used everyday words which most people can under- 
stand. 

-That every area was taken into consideration* 
-They were easy. 

\«Jl-iat did you like least about the checklists? 

-There didn't seem to be enough places to put "other" and "for 
example" 

-I found it difficult to answer "frequency" questions and to 
explain situations involved. 

-Nothing 

-They were vague at times. Just a more detailed form should be 
available. 

did you like best about the nanual? 

-I like the illustrations best. They made the problems stand 
out in my mind and they were easier to lool for. 

-Illustrations, definitions helpful, clear explanations of what 
to look for, well organized. 

-Helped me know which things to look for (especially in speech, 
hearing, and vision).. I would like to read or study the manual 
at the beginning of the year and then observe the children and 
use the checkllsL. 

-I liked alJ of it. I think it was wonderful. 

-It made me study the child more better. A handy checklist in 
areas in which the child is having difficulty. 

-Very helpful, especially the guide which has many points that 
are useful and good explanations as what to look for. 

-It was very helpful, also the explanations are very helpful. 
-Convenient to use and helpful. 

-I wouldn^t know about ijnprovemcnt of the OCR. I would think l.he 
guide would be very helpful to all teachers. 
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-I think it can help beginning teachers or those who have 
difficulty finding out about problems. 



-I very much like having the guide handy, as a quick'^Tef erral for 
certain situations. The sources are also good information 
because sometimes professionals are unavailable. I think it 
would also be very helpful to re-check the children during the 
2nd semester and as a sort of guide for the 1st grade teacher. 



V/ould you recommend the OCR to other teachers? 

12 yes responses, no negative responses given 



Other Comments: 

-Maybe there should be some qaestions about the sleeping habits 
of the children. 

1. Do .they sleep well? 

2. Sleep walking. 

3. Bad dreams often that result in becoming upset or crying. 

4. Fear of closing their eyes. 

-There should be a place on each checklist for the teacher to say 
that none of these things apply to this child. 

-In the vision section of the manual (p. 18) it was mentioned that 
a teacher should know what type of visual screening test will be 
used so she can prepare the children for it. As the visual 
screening person can tell you, this was evident in my claiijs. The 
children did not understand a certain part of the test. I tried 
to explain and demonstrate what was expected, but they could not 
grasp the idea or could not coordinate their hands and fragers to 
point in the direction the E was facing. Perhaps another type 
of test could be used for the young children (Note: The Titmus 
Telebinocular test for visual screening was used in this class.) 
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APPENDIX A 
CHECKLISTS 
(PILOT TEST VERSION) 
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May 1976 



Name 



Observer 



Date 

Birthdate 

Age 

\ General Checklist 



yr. 



mo . 



yr, 



mo . 



day 
day 



yrs , 



mos , 



EKLC 



1. Is frequently sick or seems to ha^"e poor health. (A) 

2. Frequent colds, sore throat, runny nose, or cough. (A) 

3. Frequently complains of pain or ."^ches. (A) 

4. Often seems tired; lacks energy. (A) 

5. Frequent or extreme hunger or'thirst. (A) 

6. Seems very small or thin; underweight. (A) 

7. Eyes appear to be red, watery, crusty, or sore. (B) 

8. Seems to have trouble seeing. (B) 

9. Seems to have trouble hearLng. (C,D) 

10. Doesn't speak clearly; speech is hard to understand. (C,D) 

11. Doesn't often talk in class. (C,D) 

12. Extremely restless all the time; can't seem to stay still. (C,D) 

13. Does not get along with other chil^lren. (E) 

14. Very easily upset; has tantrums or cries oitcn. (E) 

15. Has extreme difficulty paying attention and concentrating on what 
he is doing . (C , D, E) 

16. Seems unaware of what goes on around him; seems to '*live in his o\>m 
world." (E) 

17. Acts like a much younger child; seeras very slow Cor his age. (E,F) 

18. Seems fearful, anxious, or tcr.se much of the tiiii'.i. (E) 
J, 9 . See nis un u s u a ]. I y clumsy or a wku' a r d . ( F ) 

20. Stands, sits, or v/alks in an unusual v/ay. (F) 

21. Cannot v;ork with toys or play games as well, as oLiier cliildron his 
age. (F,F) 

22. None of tlie above items descril^ct this clii'ld. 
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Name 



Date 



Observer 



A. iloalth Checklist 

1. General pliysique 

Extremely overweight 

Extremely underweight 

Sudden loss of weight 

Uncoordinated , clumsy 

Other 



Skin condition 

Very pale complexion 

Dark circles under eyes 

Itching or rash. Where? 

Sores. Where? 

____ Wounds or injuries. ^-Tnere? _ 

Cuts and bruises slow to heal 

Other 



3. Head and mouth . 

Lice 

Sore throat 

Bad teeth 

Runny nose 

Other 

4. Limbs and extremities 

Deformity. Explain _ 

Bluish tinge to nails 

Other 



5. Sigi.s of illness 

Excessive fatigue 

Fever 

Other 

— f ■ 

6. Complaints or reports of distress 
Headaches 

Stomachaches 

_^ Body pains. l^Hiere? 

Earaches 

Other 



7. Breathing 

Mouth breathing 

Difficult or wheezy breathing 

Shallow, rapid breathing 

Coughing 

Other 



^0 



8. 



Diet and eating 
Seems to 



be getting a poor diet. 



Explain 



Excessive hunger 
Excessive thirst 
Poor appetite 
Protruding stomach 
Eats non-foods. Miat? 
Other 



9. Restroom behavior 

Frequent bowel movement 

Frequent or painful urination 
Vomiting 

Other _ 



10. Overall health seems to be 

Improving 

Getting worse 

S ame 
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May 1976 

Name 

Date I 

Observer 

B. Vision Checklist 

1. Seems to have something wrong with eyes \ 

a. Red, swollen eyelids 

b. Crusts or sores on eyelids 

c. Red, watery or cloudy eyes 

d. Drooping eyelids 

e. Complains of pain in eyes 

f. One eye "wanders" 

g. Eyes "cross" toward nose 

h. Other , 

When does the problem occur? 

2. Seems to have trouble seeing 
a. Rubs eyes 

b. Does not focus his eyes 

c. Does not look at work 

___ d. Leans very close to work 
e. Squints 

f. Tilts head or closes one eye 

g. Bumps into things; trips over objects 

h. Lifts books and pictures off table to see at an angle 

i. Other 



When does the problem occur? 
3. Associated problems 

a . Frequent colds , allergies 

b . Headaches 

c. Other 
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May 1976 



Name 

' Date 



Observe!- 



C . Heari n g Check list: 

Condition of ears 

a. Complains of earaches 

b. Tugs or pulls at ears 

c. Drainage from ears 

d. Excessive wax or dirt in ears 

e. Other 



When does the problem occur? 

liearing 

a. Does not listen 

b. Has trouble following ajrections 

c. Seems to have trouble understanding 

d. Uses gestures instead of talking to communicate 



e. Does not respond when spoken to from behind or froni across 
the room 

f. Does not react to sudden noises 

g. VJatches speakers' face very closely 



h. Asks for frequent repetitions (Huh? What?) 

i. Speaks very softly or in a monotone 
j. Unusually loud voice 

k. Turns head uo one side or other 

1. Other 



V/hen does this problem occur? 

3. Associated problems 

a . Frequent colds , sore throa Ls , ' e tc . 



b. Speech problems 

c. Diz7.iness 

d. Reports of riiv.^ing or whistling in cars 

~~ ^ 53 



^ e. Other 
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May 19 76 



Name 

Date 

Observer 

C hecklis t 

1. RLspronourices ceri. . unds . ones? ^ 

'Z. Mispronounces certain words. V/hich ones? 

3. Speech cannot be understood 

4. Leaves sourds otf the ends of words 

5. Omits most consonant sounds 

6. Tongue sticks out when talking 

7. Frequently repeat.^ ]\Lmself on words or phrases 

8. Frequently repeats sounds or syllables 

9. Many interjections (uh, mm, etc.) 

10. Speaks very slowly 

11. Speaks very fast 

12. Starts to say something but stops u.-. if 3 ooking for the right word 

13. Seems bothered by his speech problem 

14. Voice is: 

a. hoarse nasal, whiney 

b. soft, quiet e. other 

c. too loud 

15. Has trouble understanding what is said to him 

16. Has trouble expressing himself ' 

17. Talks very little or not at all 

18. Talks like a much younger child 

19. Other 

20. Associated problems 

a. hearing problems 

b. frequent coughs, cold-;> etc. 

c. missing teeth 

d. other 
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Miiy 1976 



Dat. 



ERIC 



Obsurvur 



D . S£0 e. ch Chockl ist: 
Luglish/Spanisli 

1. Mi.^5pronounccs coriain souiui" UHiich oiios?^ 
a. English Spanish 

2. MispronouncoL" certain word . V/hich ones?__ 
a. Englisli b. Spanish 

3. Speech cannot, be nndersrood: a. Knglisli 



b. Spanish 



'\. heaves sounds off the ends of w-ord,?: a. English 
b. Spanish 

5. Omits most consonant sounds: a. Enp.lisli 



h. Spanish 



6. Tongue sticks out when 'c^ilking: a. English 



b. Spanish 



7. Frecjuently repeats himself on words or phrase'^ : a. English 

b. Spanish 



8. Erequ'ntly repeats sound;, or syllables: a. 
b. Spanish 



En r1 ii 



9. Many interjections (uh, mm, etc): a.. English ^ b. Spanish 

10. Speaks very slowly: a. English b. Spanish 

11. Speaks very inst:: a. English b. Spanisli 

12. Starts to say something but stops as if looking for the right word 
a. English ^_ b. Spanish 

13. SeciTis bothered by his speech proiiler. 

1^1. Voice is: 

a. hoarse 

b. soft, quiet 

c. too loud 



d. nasal, whiney 

e. other 



15. Has troul^le understanding what is sa"id to him: a. English 

b . Spanish 



16. Has trouble expressing himself: a. 

17. Talks very little or not at all 

18. Talks like/a much younger child 

19. Other 



20. Associated prolv-enis 

a . hearing problems 
b. frequent couglis, colds, etc 

c. missing teeth 

d. Other 



Er.glish _ _ b. Spanisli 
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May 1976 

Name 

Date 

Observer 

F. Motor Ciicckl ist 

1. Poor or unusual posture 

2 . \ ■ k ' r.g 

it. pigeon-toed; turns toes in 

b. turns toes out 

c. vvalks on tiptoes much of the time 

d. stunhles or falls 
e . V/;! I ks t \ -legged 

f . Other 

3. Does not alternate feet going up or down stairs 
A. Runs or jumps v;ith unusual difficulty 

5. Apparent weakness of muscles 

6. T^v^itching or jerking movements 

7. Trembling or shaking 

8. Coniplalns nf pain after physical exercise 

9. Fine motor 

a. Has trouble picking up small objects 

b. Cannot stack eight l-inch cubes 

c. Cannot work preschool puzzles 

d. Has unusual trouble using crayons 

e . Other 

10, Missing or deformed lim])(s) 

V:hich? 

Describe ^ 

Other 
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May 1976 



Name 

Date 

Observor 

K . Beluivioral Checkli st: 
(Write on back of paper if necessary.) 

_ _ 1. Crying or tantrums (circle one or both) 

a. In what situations? 

b . llow of ter." 



Wi thdrawal 

a. In what si tun tions? 
b . . How of: Leii? 



Res tlessiiess 

a. In what situations? 

b. How often? 



Problems getting along with other children 

a. Hits or fights phy^-ically v/ith other children 

b. Yells or calls names 

c. Does not cooperate; bothers or interferes with others 

d. Avoids other children; does not interact with them 

e. Otlier 

Problems getting along with adults 

a. Avoids adults; does not interact v;ith them 

b. Clings to adults 

c. Hits or fights with adults 

d. - D-^mands constant attention froni adults 

e. Other 



6. Alv;ays plays by himself 

7. Destructive behavior 

a. Tries to hurt himself 

b. Tries to break objects, and toys 

c. Tries ♦o hurt other children 

8. Frequent changes of mood 

How frequent? 



In what situations? 
What happens? 



9 . Nervous habits 

a. . Puts hands or fingers in mouth a great deal 

b. Fidgets or "fiddles'^ with handS; snail objects, clothing, etc. 

c. Other ^ 

10, Very siow in speech and language developnent, motor skills, social 
behavior , an_d learning dovel opnien t 

11. Other learning problems 
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APPENDIX B 
IN ^'RUCTIONS' FOR CONSULTANTS 
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Southwest Educational Development Laboratory 

211 East 7th Street, Austin, Texas 78701 • 512/476-6861 



May 17, 1976 



Dear : 

Enclosed is one copy of the Observational Checklists for Referral (OCR) 
and a brief synoT>sis of the OCR, previous statistical results, and our 
expectations concerning your review. 

As the OCR has been used by teachers and has been reviewed prevlo -sly, 
we plan this review to be the final consultants input on this measure. 
We hope that the OCR will be ready for publication in the fall and would 
appreciate your analysis of both its content and its usefulness. 

Thank you very much for aiding us with this project. 

Sincerely yours. 



Joyce Evans, Ph.D. 
Director, Special Projects 

JE:kd 

Enclosures 



r. Q 



IS 
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OBSERVATIONAL CHECKLISTS FOR KEFERR^VL 



Inf ormatioM for Consultants 



The Observational Checklists for Referral (OCR) is being developed as 
a guide to assist preschool teachers in observing and identifying child- 
ren who need to be referred for professional evaluation. It is de- 
signed to aid the teacher in making referrals and to facilitate com- 
munication between the teacher and the professional. 

The OCR consists of an instructional manual for the teacher, a General 
Checklist to be completed for all children in the classroom, and six 
specific Checklists to be completed on all children who have been 
identified as having some difficulty on the General Checklist. 

The OCR manual includes specific, detailed instructions for completing 
each checklist, a general discussion of each Specific Checlclist . 
the problem area it is designed to identify, descriptions of co::».:.oa 
behavioral manifestations of those problems and guidelines for making 
and follcwinc. up referrals. Observational skills and techniques are 
explai:i2d, a^: veil as description's of the specific behaviors the 
teac':C'i"i rjliovid iiote in each child. 

Explan^^ciDns arid descriptions are v.Tritten in nontechnical language for 
use by paraprof essional as well as professional Head Start and Day 
Care teachers. The language used throughout the manual is, therefore, 
designed for the reader who has not had extensive training In education, 
observational techniques, or screening procedures. 

The General Checklist contains iter:is which are designed for initial 
identification purposes. They are designed to cover, in broad terms, 
common visible or behavioral symptoms of problems in young children. 
Each item on the General Checklist relates to one or more items on 
Specific Checklists. The Specific Checklists describe unusual be- 
haviors or physical symptoms in greater detail. The Specific Check- 
lists, when completed, can provide information about the child's class- 
room behavior which leads to an appropriate referral for a , more 
comprehensive evaluation by other professionals. 

A pilot validation study was conducted in order to compare tdacher- 
administered OCR results with screening evaluations performed by 
external consultants and SEDt. staff members (clinical child psychologist, 
educational diagnostician, pediatrician, speech therapist, and nurses). 
There were 87 children involved in this study, of whom various numbers 
had follow-up screening by the professionals. Preliminary analysis 
attempted to determine the over- and under-r ef erral rates for each 
checklist. Over-referral was defined as a positive checklist rating 
and a negative screening rating following professional examination, 
and under-ref erral was the opposite. The OCR Motor Checklist (N=71) 
had a 12.7% over-referral and a 1 . A% under-ref erral rate. The Speech 
Checklist (N=74) yielded a 10.8% over-referral and a 12.1% under-ref erral 
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rate. The Hearing Checklist (N=58) produced a 19% over-referral and a 
5.2% undcr-ref crral rate. The Health Checklist showed a 14.1% over- 
referral and a 29.6% undcr-r ef erral rate. The Behavioral Checklist 
(fi^^ll) showed a 4.5% (one child) over-referral and a 22.7% (five 
children) under-r ef erral rate. 

The staff of the Ability Development Project vjould like to see these 
percentages brought within a more limited range, A large number of 
over-referrals would tend to discourage the professionals who are 
performing diagnostic evaluations as well as increasing the cost to the 
schools or parentis of the children for no beneficial purpose. A l.-^rge 
number of under-r e£ errals would, of course, defeat the purpose of i.ue 
OCR as a screening device as children who are in need of attention 
would not be identified. In this frairework it is definitely better to 
have a moderate over-referral rate than even a mild under-ref erral rate. 

It is our hope that as a consultant reviewing the OCR, you will contribute 
the following? information: 

1. Suggestions for modifications to the instructional manual. 

2. Specific suggestions for additions and/or deletions to the 
General Checklist which \;ould provide for more accurate referral 
to the appropriate Specific Checklist. 

3. Specific suggestions for additions and/or deletions in the 
Specific Checklists which would enhance the probability of 
accurate identification of children having difficulty. 

4. Any suggestions which might serve to limit the over- and under- 
referral rate. 

5. A general statement of your assessment of specific parts of the 
OCR and of the measure as a whole. This includes your assess- 
ment of the need for such a measure and its usefulness in 
aiding teachers in communicating with professionals in pro- 
viding referral information. 

6. Your evaluation of the clarity and readability of the manual 
as a whole. 

7. Any additional suggestions for revision. 

VJe feel that there is a definite need for a screening device which has 
reliability and validity, and can be used by certified and non-certified 
teacAers. At the present time no such device exists which deals with 
all tVie major areas of potential dysfunction which might impair the 
learning ability of the child. Of the screening devices which are used, 
all a^ designed for use by professionals and are usually for use by 
person^ with professional training in that area (e.g.: medical screenings, 
spee^^Tscreenings, etc.). The OCR is designed for persons with no 
knowledge in the specific screening area. It must, therefore, rely on 



the observer to note specific behaviors and not on an underlying 
understanding of the cause of the symptoms. If it meets this object- 
ive then it should be of benefit to all who work with young children 
including those to vhora cliildren are referred. 
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TO; 



DR. JOYCE EVMS 



FROM: 



Ernest Go. 



REr. 



OCR Review 



Enclosed you will find: 

1. Consultant Forra 

2. Note pad and a few additional pages of comments, recommendations, 

and so forth. 

3. The OCR copy with coiTinients written in the text. 



A. The consultant information sheet. (with comments) 

I am really pleased to see the excellent job of pulling t ;:ether you 
have done on the OCR. Though it ray seem that I have ma; --.d a great 
deal, most comments are not related to major problems. If I may be 
of further a,ssist?nce or may clarify anything for you, please call w^. 
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RevicAv of OBSERVATIONAL CHECKLISTS FOR REFERR.\L 
by Ernest Gof.ts, Ph.D. 



Suggestions for mo. .tions to the instructional manual. 

In the paragraph, "The importance of the teacher in early identification" 
the term professional is used. This may be a red flag \.ord since you seem 
to aim this at teachers who do not hold professional degrees or certificates 
also. Is there a way to word this so an not to offend? 

In the paragraph, "The importance of early identification" You have used the 
tern, visual impairment, here in a V7ay that is unusual for the field. In 
general, visual problems such as refractive errors or amblyopia which may be 
corrected through prosthesis or exercise are not called impairments. The 
terms, impairment and disability are reserved fci' use when all possible 
correction has already been made and some Interferance with function is still 
evident . 

In the paragraph, 'Hov7 you can help in early identification" The subheadings 
under this section do not conform to usual practice in education and psychology 
This level subheading is usually indented as for a paragraph and underlined 
as you have done. 

For V.Tiat age child is this checklist intended? Young child is first mentioned 
on page two and is left vague (i.e., not defined). If it is intended foY a 
specific n'-.r^e range, '-hat information could be included on page 1 in the first 
sentenc- follows: 

"The purposes of the OCR are to assist teachers in identifying preschool 
aged (and elementary) children who may have problems..." 

Throughout, the OCR refers to school - do you wish to imply that a Head Start 
center or a day care center would not also find this useful? It is awkward 
to do so, but perhaps every where school is found it should read school or 
early childhood center. 

For third full paragraph, I tiuggest ; idd as indicated on marked copy, "or 
what you have noticed about his behavior that is unusual and.^.^." "referral^^ 
person" is an awkward term. How about, "professional worker^' or "expert." 

Following Tnrou^h on Refer rals 

I would prefer to see the... 

"it is important that you know followed by what reconimendations have been 
nade to help you work with the child and vT^aL the nature of the problem is 
if special attentiveness is needed on your part. If the recommendations are 
not clear to you, you should ask for help in understanding them." 

TO: 1. De-emphasize what might be an interest in the label of the problem 

2. Encourage follow through when recoitimendat ions are vague, too wordy, el 

Also, same paragraph: 
extra lighting should read "special lighting." 
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OCR review Ernest Gotts 
Page 2 



Mention of resource teacher in this paragraph. This is not followed up 
elsewhere in the OCR or maybe it should be. 

Comment regarding computation of the CA 

\<h. was the computational procedure not explained on page three? I do not 
feel the explanation was so long that it could not have tit chere a:, well 
as being appended. 

In the General Checklist instructions third fi I paragraph: 

I feel it would be helpful to include here an explanation of cUe letter 
following the item of the General Checklist. 

Other x^ording changes for page 3 are included on the page itself. 

2. Comments on the General Checklist itself. 

1. my not include a space for identifying the school or center? 

2. Suggest you add item "Has lots of bruiset, and/or sores on arms, ^egs, 
or other body parts." (A) 

3. Suggest you add item to the effect that: "Behavior varies markedly 
from day to day." (E) 

4 Suggest you add items: "Shakes or trembles after" (Z) ... 

"Often stares blankly into space or nods head 
and stares or smacks lips and stares into 
space." (A) 

3. Suggestions Regarding the Instructions for the Specific -e^ckiists 

In the first paragraph: 

Reference here the previous comment. The explanation of how to use the 
letters which follow items the General Checklist comes after the 
General .ecklist Itself has been discussed and left behind. 

In same paragraph: 

In enumerating the checklists, the word, check, ist, is included with 
Beha^ioS inconsistently since it is left off for the Hearing - Speech 
Motor ones. 

In paragraph 2: 

The antecedent of they (as marked in text) is not clear. I suggest yo>. 
start the sentence, "The specific checklists... 
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OCR review Kmest Golls 
Page 3 



Paragraph 3: 

Is a. caution against sending the only copy necessary? 

In the first narrative paragraph: 

The minor but poteuLxally damaging illnesses run cogether v.ith . 
severe, disabiling diseases. 

Perhaps you should consider using an expression other than "recur" 
maybe - which breaks out again and-a^^n 



First full paragraph: 

I wonder how the word "abused" will be taken by users - it could mean 
sexuaUy molested to some. Would the ter. "beaten" be more accurate 
aid most likely to communicate? 

1 suggest you add to paragraph 1 (page 9) an admonition to observe 
Scratching behavior. 

Paragraph 2 

"Another indicator of lice" is used without making clear vhat the first 
indicators was. Suggest that they watch for scratching of the scalp or 
nape of the neck . 

Something is .^ong with the statement about tooth decay. Was a line 
left out? 

I think tha-- these general directions for the health checklist should 
include reference to impetigo and to pus -. bearing sores. 

For inspection of hands, suggest o-bservation for hangnails of symp^^^^ 
of petit mal and psycho motor seizure disorders would be appropriate. 

For second full paragraph on page 10. 

Could add: "Children of ten communicate illness by ^'^'^i^^lj''^ 
extreme sleepiness at an unusual time.jlcpy demeanoi , and so forth. 

In last paragraph of page 10 

Suggest you admonish them to observed for scratching of anal area - 
pin worms 

G7 
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OCR Review Ernest Gotts 
Page A 



Suggest you add to paragraph on "Follov Through" 

"Never give a child any kind of medication (even aspirin) unless 
instructed to by the parents and with written schedule and amount from 

' ) 

physician. _ 
On the Health Checklist Form 

Item 4: Is the word, deformity, at the appropriate reading level 
(Physical defect, abnormality) 

Item 9 

Suggest you add: "Scratching." 

15 Vision Checklist Instructions: 

same comment on the term "visually impaired" as on page 1. 

You may wish to add to the narrative paragraph on P^'-f -mme: ts 
concerning the child who needs corrective lenses. - distorted or 
fuzzy, blurred vision - who squits to compensate. 

CoLninents are written in text and seem .elf explanatory. 
Comments written in text. 

1. Refer reader to previous page which illustrates the Snellen chart. 

9 After "...left, right, up. or do.n.." add "They can do this by turning 
the fingers on their hand in the sa::.. direction as th^ legs of the I 

Ignore comment on headaches. Consider .ause.-, under associated problem - 
muscle imbalance and eyes can cause llu--.. 

On page 21: 

an alternative on all of tliesu pliy.s.-.ai and ..cn..c ry i 
On page 22 

no you want to acid nausea to di./in-.s a:: a syn.ptcnn of ear problems? 

On page 25 

Hearing Checklist 

1. condition of the ears:' Sugj-c.t you add "Sc;,... I che. at car:,." 

58 



16 



19 



OCR review Ernest Gotts 
Page 5 

On page 25 ' 

3. Associated problems 

Suggest you add: Signs of Frastration - Temper tantrum 

Irritability 
Hyperactivity 
Distractibility 



On page 27 

Corrections and common f:s in text. 
On pa[:e 28 

In tlie first full para^^raph the sentenct '•Remember that the child's 
first language etc..." seems vague or unclear to mo. 

On page 29 

I suggest that you add the sentence as indicated in the text. 
On page 30 

I suggest that you add i.ndor Associato ' ' '-oblems (e) "brc^athes 

througli moutli." 



On page 35 

My mor,t serious quostione; about ;iny rlio 'klist relate to the one in 
behavior: 

1 feel thuL tlie ]ead-iu matorial slioiild be moro detai.Ud on c]:is 
particular checklist since this is the area where the signs are 
most easi ly confused v;i th normal l)ehavior. 

Under "Whar. to look for" y^Mi could have 

Excessive - in terms of frequency or degree 




fear 

anger 

crying 

li Ices 

d isl ik(.»s 

possess i von c Si-. 

wlri nines5; 

mas t urba t i on 



eryi ng 

t ouch i ness 

changeali i.l i ty or 

sadness 

distructivcness 
day dreaming 
fa n tasy 
rock j ng 



ha.pp 1 nes s 



'.1 rouble v;itli: 



Adults and/or clii Id run 
I'aying ateonl ion 
Sitting or Standing St i 1 l 
Impulsct C-ontiol 

era t. ion of 1' rust rat ion 
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OCR reviev/ Ernest. Gotts ^ 
Page 6 



Aggresion 
Demanding attitude 
Tantrums 

On page 35 

The word coping, I feel is a middle class high-shoot educated 
or above term - Suggest you use handling or dealing. 

Under making observations paragraph; 

Suggest insert after first sentence: "That is, we will see them in all 
children at some time or another," 

On page 37 

Comments in text. 
On page A 2 

Comments in text/ 
0.1 page A3 

Comments on page in text. 

On page A5 

In enumerating the various items the form of the expression switches 
again and again. Suggest r. standard format. 

walking r ^ " 

Suggest under you add: "Shuffles, scuffs, or drags feet. 



Con-.nents on the appendix and Table 1 are written on the text material. 

4. Suggestions concerning m iul,. L.ation of the over- and undcr-ref erral rate. 

I feel that the data you quoted concerning referral rates are not at all 
bad \or this kind of instrument. With some of the additions or clarifications 
suggested in this round of review it should improve a little. A training 
paSa.o to go with the item which presented perhaps more detail and P-'Viced 
opportunities for reading and discussion might help teachers to use he OCR 
more effectively and thus to improve the under-ref erral over-referral sitaulion. 

70 

60 



ERIC 



OC R review Ernest Gotts 
Page 7 



5. 



1 feel that with the sugsasted changes and careful technical editing that 
the OCR is getting the the General Instruction, Instructions for the General 
Checklist, the General Checklist, the Instruction for the Specific Checklists 
and all the Checklist, (with perhaps the exception of the Behavioral Check 
list) are quite strong. The behavioral checklist may be the most problematic 
for what is needed is specif ici .:y of reference to behaviors and at the same 
nonriseness so as not to make lu.. checklist too lengthy or, too cumbersome to 



■ Actually, you could sLyle this as a twp «tep- screening procedure for use in 
c5assroIn,s by teachers. 1 feel-there is a real need for this kind of com- 
prehensive look at children which avoids a testing approach per se but suggests 
how the information needed to complete checklists can be collected on an 
ongoing basis by the classroom teacher. 

F.ven the field of special education where teachers are supposed to be highly 
trained and so forth seems to skimp on preparing teachers to look for signs 
of problems. ThisV^ype of material could be used by a resource or helping 
teacher to train clSssroom teachers in early childhood to refer potential 
proble-us. The instructions for the OCR could be stronger xn encouraging 
teachers to insist on recommend..tions that ar. \-'^l'-\\°\'']''^'ZTo the 
activities and specific enough to be implemented. lor the lead-in to the 
Behavioral Checklist - the possibility that the professionals - - -P-^ 
back to the teacher may recommend that the teacher observe the child m 

ertain specified areas and report back to them at: a specified -time prio, 
to making any kind of decision about the exact nature of the problem or 
about how to approach dealing with the problen. 

(). Clarity and Readability: 

" I h-ive to give the OCR an overalf strong rating for clarity and readability. 
After the current round or editing it should undoubt:edly be even cleare. 
and more readable. 

7 Other Suggestions not regarding the OCR itseH:. BuL 1 do suggest that 
a ra n-ing package be developed to a, ..cmpany the OCK that -'P-.v.sors 
helping teachers, and so on nay have a r.sourco fur ,ntroducrng the OCR 
to their teachers. 
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Natalie Barraga, 



Review of Observational 
Checklists for Referral 

r 

Generally, the instructions • ore well written and easily read. In each section 

it might be well to- repent that most children show some of beh^wiors at 

one tim.e or another, and that only those behaviors which occur over and 

over should be checked. This may help to cut down on some of the over-referrals. 

Might add after 8: "Doesn't like to do things which require him to look 
closely. Nos, 12 and 13 - add B in parenthesis. 

Page 15 - add to iiirst sentence, "or he nay get tired easily when he is 
trying to do any of these things." 16, 17, 18 -well done 

Page 19 - Under 3 add: "Becomes restless after few minutes when doing any 
close work". 

t\£ I said under No. 2 repeated caution that most or all preschool children 
exhibit some of the behaviors occasionally, and that only those which happen 
repeatedly should be checked. 

For under-ref errni* , might suggest the teacher keep the checklists in view 
or refer to them weekly to refresh the things to look for. Might also suggest 
they work on this over a period of several weeks before making referrals, 
rather than trying to do it for all children in a few days or a week. 

Overall the OCR should be a very useful tool for teachers of all young children, 
especially those who have less sophisticated preparation, or those who really 
don't know what is normal or unusual in a child's behavior. There is a 
definite need for such a measure for day-care centers. Head Start programs. 
Early Childhood Education Programs, and even primary teachers in the public 
schools. My experience indicates that anless workers and teachers have had 
some special education training, many simply do not know that certain behaviors 
indicate aiiy type of problem, or do not think about anything wrong. 

Just having the medical terms explained in understandable language vill make 
teachers more comfortable and more willing to make referrals. 

The j.,adjbility and clarity of the :naiui:il is quite satisfactory. I Invited 
a friend who had no college course work .tor any real knowledge of children 
to read it and the coinnKtnt was: "even I can understand those words". 

Do you need both pages 31 and 33'r Page ^^9 - Under State*. Agencies: add 
Tctxas Education Ag^enc-y, Division of Spec ill Fducation. 



Frederick N. Martin, Ph.D. 

CONSULTING AUDIOLOGIST 

8613 Silver liidjje Drive 
Austin, Texas 78759 



l.ivj 25, 1976 



Joyce Evans, Ph.D. 
Director, Special Projects 

Southwest Educational Development Laboratory 
211 East 7th Street 
Austin, Texas 73701 

Dear Dr. Evans: 

Thank you for the opportunity to review your OBSh^RVATIONAL 
CHEGKLISTo FOR REFERRAL. I have read this document through 
several tines a.nd hope that my comments will be useful to 
you. 

In ny opinion this is <l well-done pamphlet. Publications of 
this sort are often overly technical and disinterest thr^ ver 
persons they are trying to reach, Ycu have stinick" a balance 
between brevity and detail with no major sacrifice in accura 
although I am certain that there are purists from each speci 
area who might groan at thf? oversimplifications. 

Specific comments will follow as outlined in page 2 cf your 
Info r m.a t ion for C o n s u ]. t an t r> . 



1. As stated above the manua.1. well^-Vv^ritten and 
succincl:. You might wish to consider a brief glossary of 
terms which are de? .ed unusual for the reader. This would 
require som.e slig u paraphrasing and need not run more than 
a page or two. 

2. No sugge'vi Lo:\s f o - gene? ai .::'ieckxist . 

3. The only c/ieclLlist I liav:^ commen'^" i on is the one 
on hearing, siricc. t ojily feel cu i.ified in this area, I ani 
certain your other consul cant .; may find some reasons for 
change in their sj^cclfic ciiscj.pline.-.. Phe comments on the 
hearin:-: section i ":q aoper.-J.r^l to this letter on separate siic^e 

•^1. On the matter r.r urdei- ^cid over-referral. The do" 
you sliow indicates that the ;)OpulLr ^on t".hus far has been 
ratiier small. V/h-^n it gr: s 1 :-ger you might generatr- a 
tetrachoric table and prrf -rm chi square to deterrijrie yoi." 
hits and misses wi .<h rr},:jeet to ?:'efe\^ral. For cxnmplr , ijCj. 

7 *) 

- T J 

<:>?, 



Frederick N. Martin, Ph.D. 

C 0 K S U LT r N G AUDIO LO GIST 
8013 Silver lJidj;o Drive 
Austin, Tt'\as 78759 



zi gro'jo of children at ranclo!:^. v;ho have been in one of your 
pro^:ra:n:-j and do a complete hciiring test on them* I am sa.'^e 
wo ca>i set up some arrangement for this. The number I'.O r."; - 
wayjj works nicely in such casor.. In this way you can de :-..'- 
i:iine the ner cent who failed who should fail, who pas:..*-" wao 
should luisG (hits) and those wno passed who should fail and 
failed who should pass (misses). Our humanitarian insti.nct-.: 
(and your information to consultants) tell us it is bet'-r 
to over-refer tiian to under--ref er. In the hard light of iay 
most pro{^;rams are jud£;;ed by xheir efficiency, whicn is usu- 
ally defined in terms of money, personnel, equipment and 
time. In ':uch cases accuracy and efficiency appear to be 
inve-' .-\Lv related since thf.^ more children whose hearin,:^. yc..} 
attervet to screen the .looser .nar criteria are for^a "Vi....-::^' 
and tht^ raore likely you are to misjudi^e. If you tighten 
on your criteria your efficiency goes down. 

5. As Implied earlier, r.y general impression c': the 
Ccn is favorab.LCr I'^y comments are' limited to the h';.ring 
section r; p eelflca].ly. 



Viie manijn] :s genere.lly clear and well written. 



7. I have n.o ,-;eneral sii^gGst ions for revi.-ion of the 
p.'<nn::- "1 'but cxo ^rive tnis comment with respect to t ••).•• hearing 
cne--']^st, altho'jr'^ I did not include it in my review of the 
pn o':: or. this sub'3"«ct. You havc nowhere tried to identify 

with atK^li.ery •orocrrsing problems v/iio iiav- normal 
P^'a-m-,-^ sensiti vit:, . One of your teachers or parapr --.f ession 
pi '3 -m '^at suspect e. hearin- problem in a ^>hi]a wao tests 
out ru-.-.M-lly. [• is sometij.irs a mistake to snrug this off 

ov.n-'-rofcrral for the r -lild may need a s,:;'cial form of 
iioln'and the earlier In i i f e ho gets it the bei-cer off he Is 
. v;-, -'i (, r '--Mviee In your Ma.nu':n could be very useful on this 
i; 1 ) :j ^' ■;* e t , 

p..... th-ufc o\\ vo-r ci] lowing n^e the oy:port uriixy to 

^:-o,;>/ ';;^>nKJ . " if you wish to discuss this report furtiie 
•{ v;o.:].d be m<-)st plee.:.-:d to r:pee\ with you.^ 'lm..is J:. a \.iac^ 
i. rifteuld .n^ovc^ to oe ver-y \^uv q . 

:;lnc'^":'ely , 



/re tier.! c-: . :."a vX \ 
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COMMENTS OU 
Hearing', Checkli.s L Inr.truct ionr> 



l: eats rci'ei' to Items numbered in the. loft hand rnargiii. 

1. i v7ould suggest: a difforonL ordoiung of "Whbi'e to refer," along v;ith reasons 
•■ - roforrai. 

J. Speech patho.logisL or school nurse ( f'or screening,). If there is soine 
uncertainty about hearing loss or on a routine screening basis. 

?. Audiologist: professional v/ho tests hearing and manages hearing' impairment 
If a hoa^n'ng loss is probable. 

3. Otologist or otolaryngo].ogist : Physicians who specializes in medical 
problems of the ear. 

If an infection or oLher meciical problorn is suspected. 

2. In -^his section ther^ is an implication that a child vjith a mild hearing loss 
Tr.i;^hv not hear a car horn, etc. This is unlikeJ.y in mild problems but might 
suggest a severe loss- 

At the end o: he rext-to-las: t sentence 1 would add allergies to colds as a 
causc: of ear infections in children. This is a prime cause, especially in. 
"arts of Texeis liVe Austin. 

I v;ould chcuige ' . . .you will noL be able...'' L^o '\ . .you may not be able...'' 

The more positive statement: inif':ht mjslOrid the nonprofessional." 

:. In this sectioii the subjecL seemr; to b^e the severely hearing-impaired chiJ/J . 
■zuch childreri shov; an inLere-st in sounds wlv:'n it is audible to them. 

£. Vodlfy sentence slirjd^ly lo read " . . . cb. J ch^en have speecli or voice_ prob.l eiri ; . . . 

7. Add allergies again: 'Trequent colds, allergier; and....'' 

S. Chanr,? '...in Tact, any clii Id with...*' to "...in i^a^vt , evoir;;;>^ child with . . . 'V 

■Z-^ Add a " .; v:or'ds : ",..may e>:[:''-r i ^^ncc; di::zjMess, uns tcad i iic-ss or clumsiness." 

L:, Add a dePinition for iH>rtable audiometer-, such as "A device which is capal.\le^ 
or generating a vaiMeCy of tones at dilforent strengths to te^L hearing 
sensitivity with ri pair ern-pb.cjne- fi.Ll-i tc^ tii-.' cliild's liead . " 

11. "Set" is missi^rdded. 

l.'^'. M.l). in i)art!nr". can be- d'-'letc^l after "iii-dic:i'I doet'.'?'". 

i: . Ay l-'iar^ shows li-re l.^il 1 beli-vo mose should be said about t h^- and i o] o.^ i s t . 
He/srie is a pr?rsc»n w.:u si'ecial grc>du/it:e t rv.i i ni nr. in tli-./ man "igemen t of all 
non-T-ed ical aspeets of iKvaTMn.; biipaierKsit incHudinr, the s^?iection Cil ]v.a--ing 
aids, auditory re:j'aLning, lipse^iding an 1 oiins-dlng. 
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Seating the child close to the teacher desk is not always the best things, 
lie/she should be seated near the front of the room so that any natural light 
through windows will be at his back and on the face of the teacher. If he/she 
wears an ear-level hearing aid the aider, ear should face the class. If a 
body-type hearing aid is worn the preference again should be for an ideal seat 
v;ith respect to the light. 

Ix is important to add that many children have normal hearing in some ranges 
of sound but poor hea\-^ing in others. For example 5 ■ it ■ is not ur:Common to find 
a child v/ho responds v:ell to low-pitched sounds but not to h ^ gh pitched sounds. 
Such children are often misdiagnosed as they appear to respond to sound 5/ especially 
to speech because they hear the vowel ar.d nasal components but miss man^ of 
the high pitched v/hispered consonants. Such children often have langu^age or 
speech disorders and appear to hear witr.out alv/ays understanding what/they 
hear . 

A not uncommon problem among children is severe hearing loss in one ear. The 
child who does all his/her listening wiTh one ear does satisfactorily in quiet 
surroundings but may have difficulty in understanding speech under difficult 
listening conditions, such as in the presence of background noise. These children 
also have difficulty in localizing the direction of sound. 

c. Drainage or strong odor from ears. 

1. Appears inconsistent in hearing. 

m. Difficulty in localizing sound. 

n. Other 



e. Changes in behavior after ab5i:-^nce or illne.'^s. 

f. Other 
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h; 1 J- i lit utI: 1 i fi t ( P •■ t ni 



v:'i; I : t.. 1 . .JK for: 



;:!•:' re t ! i\;f'jr: 

.] . S^.tTii p;iL]\(»;u>r, i*^. t 01- iii'ho:)] ii.ir:-.'-: (fur scir-en i tif;) 
/. Oi..- 1(>>M sL or ot oKiryngoU.g i si : phy.-i i aiis v;]io Lrf.at. 

1 p rob 1 ciTi* 

::. Aii'.lio.U.M;i:-. t : pn- f f.i.'..:io:: ^.1 who tesiis hc.^ving. 

and uudcTStana --in^^^aj^ ^ ' 'tt^ruurh 

j . •'. :^.-^y I'j-rrn ropiit; rhn wnrid atifl r.heir plnco, in i c Clilldi'.'a vr^t\ 

n 1 d h .-cir i:i Iv^^^s, rnav rjiss n.uch oT v,hat: is i-Jiici nnd nuch thaL^. 
a..;.; i - ih.' \;:rU^ aruund. They wny nft. loam, to id.'-tLry sou:\ds, and 

c:":.. d-j 'vr.. I 'I ! ' 1:1 d d 1 H t:v: t. i OD ?; . A chl.I.d w.Uii a hraj:lr\g lor.s r.ay not 
- ct! \/rPn v-:mi cal I, ^^nor lu'^r Lha liora (»f a car co:'-iM:, up tdie r-A vi-ca. 
Cr.^^ ./TX^..{lv:y i.: . : s .-^ c :U 1 , a cUxld is tu'.Lrarn ^iiid fuacti.oii r> r home cuul 
sc'ioo.l, bu*: ofc'ia th':- lif.'irLu>;-in-paircd child if; no: idcu f.if IckI because 
n-.> u:ic.- lu ticetl th*.' behavior:; llia^ sbov; Vi i:^ iKivia- nrub.l^p:'.. 



1 



cricM! (.>P the Heari:^ Ciuckliid. riwer^; 

' ^h^. hf:: 



h puj.l ; on 
a bt'a 1. Ci'i [lyrAi] i'n 



tc U:. co:..:'L^m: o)- th.'i chiLti s cays. Hova;vef, iT^.r.t 1 th- !i.:arin,. 
^- vL:^ibK>; so >ou :i:u> i T'^'iy c>n b^^ha\-io--. 

ti:^• ■: Lo:i;» ! .1 i of t>aratho^:. Kit-H^uont col^h< 

wi>..;;i ':].:.; ,ai.:-'j oar iu i r i. i ( ' a : : and duri^^a lI'j ^/ar.', i c-snl Mr^^^ in 

-i )v..xir..\ ) ^ :a. ■'•ui ail'..;!; Lhc viir::; arv ru ^ually 'r.iri!;;'. you wLM iiol 
.:h'.' uo ♦oJl r.ach about ^il^M:l. 



Ry checking; t*:': rn\.]\^orf^ l.lstf>'i in Srct'cip 2, you c.^:i ob:;-:':\t e!icctiv.:ly 
lor i;^•a^-ia^'. o : ■ ■ b.l a.ji; . OhstTvo Lhc^ (diidd durltit^ acLlvi'.lcs io vl^Lcdi h 
i-i:;L Jisica, sa-„h a'; followiuj; directions rope^^ ;.n: . rhy^ a;:d Mv-tcnin^', 

t'"' i.L(^ri'j.>. Dei'.' th*' child turn Lovard you vhL-n yi^a call hiy. nai.nc £.oLtly? 
Wnaf" dot-- he do whaa cl;art» :i ^ sudleii Ljiid nciist*? f^'-''y. T'V- boor it- at 

alj . (» ; bo .:/iy "-^.■"Wj ^>.t roni.r^l y excited b^caMse h*" did ii-^r it. A ioud 
iv'^ un-i rviy t'r i ;-;h r £i cbiild who Ir. uncd ^'^ilonoo.. iiuri.iO'^. pusic or .sto:y 
tLr.:f iio ^--iv ir^t pay nttoaLiou .tt al' aad disTiipt ih'J rl<i/;'' b^-viair.*- he 
cj.aa .o.. h' M'' tj e - ''eiic r i^t.iM'y. I-Zatrli irh:'l the cltlld does -./nea v(j'i 
law! dir-'atl / lo liir^; r^'iny h^.; r i iw;- i f red chlldreii v. Ill \':\[(:]\ tie- :,ited-.'i 
face very clo'. and re'.u^ad tc.) faeia) exe >v s i oa a a;] ^:e-;tnrce; 'nnfeal 
c»-' fO,' a:: M: i a C' v;he is said. Ih'caav''- heeri^'tp; las., i a tt^r f re>^ 
CO::., e. i <•.•.'"' a I , v.mi v; i i ] vaiil tte obsoia/e The clri ! d \oh:ii hr "is :"pe.tkin^;. 
M/:e. a*ai. ■ : . a . : I : ed ehildraai iiavc: :';peech [> /ad- 1 -.a;:.; b^^ aura* tli^^-y do :Ui t 
!'ea '..'el! ea ae;;. ( • '< m; V/''-''^ ap'' a*'.'.h . (^Lbf.'r^: will :a-v,'h way llMle 
and ' } 1 i..:-.*.- ia-aer.- ; l) e(Ji,;aaa i ca • . *i'he cbMal oMa .i liaai I a .\ haai i:iay 
^:l*,''i a-.' ^ •: I « a ac t i Vt.: -aid easily r: ^ e ( jau: tai d ; taaa- are heh.:va)Ta 

t bat a ;;■ a.' t • i i e 
n-'ea to , h.... . v. ' h- 



: t evaiy bcaaja:-e t h-.y.' j» r'.*/>e n t a \ > r\-id f ;■ t y^ »a . Yu e 



1 r. t ' 



1 1 -.M a 



aid vej V (Mrofuliy a!) a Miis leip". 
:. a hi-ai tp.'' lo..a t^; S(:ia-.' otia.-.' a a 



t f; 



1 I i ' ir. ; t (' r 1 ,1 I . 



21 



I 1 I 



.(M a 1 i f 

7 7 



if 
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, n>-o-.- As r...;-.Monnd c-arUcr, r.u.ny hear mg- i.v.p.. t red 
as the nose ai.d ' ^ . / j „ , child with a spaer.h disovdor r.h ■ 

f '^^-'^ -^'T ' '"ITl'e inV. i;ss. Bocaus. the ears are important 

h. checl-od f'-Y'-;^^^^^;;^,^^--".;' ihild with oar probl.ns .ay exp-.ricnc- 

I or"a fani-ly hicaory of hearing iT.pain.-eat. 

T . r.v n.edU.t ror Hc.rin:.'. Proble>as is not a sniv.tit:. 
H,,;^L.;- rclc,r ,,„^^. ,ehool nnr.e or 

^ : ■ sV. I^dio-^'t-^'r an<! c.iph.ncr. arc conmop.ly used fo. 

P.'Lholo.ust. . ; ;\V,,,;„a,e th. eh..,ldren for hoarhu; .cr.onln,. 



■■■■^■'■^ / ■■-IomU for the;a to irv on- Our. nr. hearing 

/ I I'Ut n-ui- oa: a sea ,.,.;„-.d to raise or,., hand vhen they 

s':re.ni.ns-., tne .h adre ^ th.ey hear 5;ouac 



out rri^r.l 1 y v.hal i'r^ 



- ^^■v^-"^'■^^;:;:in";:: u:: ..•n th. H,iid.a.hat 

-;;,:r;■;::^e:::n;:■^:;" of M,..;.o:.p.e..d hear.n. _h,.eUi:. 
•■l,;. ;u.w ..ai.h '■hiS.::e. se... t. havia, preh,-.^. 



;,, reeninr,. a ^. teri.d rh'.'-.l.l h 

78 



6 a 




:3 



. ;.>v.':;ir i.an, 5:i)-c ial i ;uri in disoafjes oi: tV^^ (-.rs only. Any cli i 1 (.1 
■ ci:s-. ;i' hut. yju SMi;n-;L a h-arlro.; loss, J.!..: child sboMlcl b. ox.sai 



;s:d-iolo-is:-, a p ro U'ss:i ona r who tcc^r:^ !u:ari:i;; ciuc] h-aiMaj; skills 
/.^.-i^adrrhc'arinc^ aid. a;:d s^-cial. M^idLLury t;:-n!!nn/;. -iu** child 
ace: bo rcf-erri/d Lo a hcaiiin-. aid C\.'::\o.r is trais \ i I t; 

r-.-irc hoctrinr; aids bviL uaL ^o nxanine the ^- .rs or tcsi hcariiM; 
.:,;iv. :arid coinp loLiKl f:h^'cl-: i i s is oa :h^-> c;h;i;^re[i y^'u rci'or Lo 

c>r au-.!olo^:isl. tic will, tbc-a laio;. .il-oui: o.a/iual beha^■^OIS 
\\-v:^ cths.'i .''S in '.h-? c 1 ^ss tiw-n. 



vs 1 'J ! an 



■h;o:j{^h. Yds wilt \^?.\\\ to . L[' !\jr:'M I. : -a fro-^ ib^- ;.i-r:-M:t w-i 
r:itid. /.-a: ho'.- Sv'V.Te th- i\ h--.ria:; lu^.s Ls, vdieth 

afrvct^vi. sa:I ha-: »ho child' - c'a.. :r.)o:: abilities are 
W rhe cuild is lo va a r a hv-arip,; aid, ha^a loiu; hv> shou1 

s;!' , i.r! see iha: h ' d^^es, y\\ th/Lt it is on .sal f.oera'ia^ 
'[[., i-d i(» I i • ar h--ii-is:. aid ('-sl-s- cas X 
■ r. _ h-'.- \.'arl;.., ^ajd ^v's i l to d.) .is ls^ 
; h".:.ia ih" olia'C cdiildi-ea, ''ill. .a* ii 
f :\ t r:i i f sds' r a f t 

i ii i ! d i,.,iV d .idd i \ \ rrsil ■ 



} 



yrs 

of diCfisLS 
i , i . ss'a r.' I • 
'...I nr a 



d>'..at Ibr: 
\ . II th 
'■•.rail./; d 

- ■ » I re.-' 



! ■!:,, sv.s :. t Is* ch i hi vh 
s ! 1 y . I, a li i a ' yo\' ' 
• si)L' d c l.s.ir I y ^ af v ' 



el .s. 1 



t>M! 
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f you :v.st ir.'i'r.-.]r ^.o^^c■ I i lor t.lic ciiiM, r.'^^h r ,j • Cr "! r:<. 
I i gill ly di : t ron t w.'.y . r n.^uurn^>/ t lie 1 1 c-ar i nj'/- irij^c! i : t ^: child 

'dc^ lU'L Lorrc-l hl^ s::o^v;h; lu: iruiy bc^cfiiu^ d i sr ( • s^; d c;ud a 
p.i;. R." v.-ry r-uro yju hnvo the cbildV^ at.r.nut: icM- bof-jre you b 
o^hin. RcvM-.v.hi-r that cl.-. child with a hearing; I^^ns may nor h 
f praLs.'; praise hini oft:*. with s.T.iJcs, pats, ar.d I '.-.s as v;tM 



BO 



; = 1 , i i ns o i C^a rcU'Ii'^Li 
: ;.'/,s or I'ull a L ears 
i-!". l:ia^;e IfOVA eai\s 

: .\ .'f'.sivo Wcix or dirt in oax's • 

rr^iMr 

t ':.)l.^s the pruL.Ici:! occur?' x 

• s not listen 

' 'I t r u lib .1. e foil o v L n g d ivoc t ion s 

L'ini; have trouble understanding 

<•:. [''.es turc'i.-; iasiead o£ talking to co::ini!nLcatc 

■'cy. not respond v;]ic;n spoken to from bohuid or fro:?, aero: 
ru- room 

.)('■■ ^ not ro.act to sudden ncM*.si)s 

■v.M ■ .'S spt.ikor's face very closely 

■ .'r irt.^qiient repetitions (Huh? What?) 
vi'^s- 1 rly L»r in a rr.oiKi tc»!ie 

i \ 1 M ■ /r> i (_C- 
f . •••.■ ,! t f ' s: le Oi o tber 

• p rob 1 e-il c i rx; v 



oo] ds , M / : bloats , i*r^- . 



of r:nj;i'i- 



1 



in e.i : 
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AUSTIN SPKKC'H. LANCirAOK. AND TiKAlUNG CENTKR 

I.AN I KHN I.ANK (KnTKH ^ lOH 
HH-^r, HANCOCK DHiV'l-: 
ArS'l'IN. TKXAS T87:U 
tki.mi'hom:: i .-j j 1 'j r. 

VA V (:v)r.i:. M.A.. ( o-Dmm.* lou 

M/. . JVKV WOOn. M.A.. CC)-ntn».< nnt 



Mny 26,19 76 

Dr. Joyce Evans 

Director , Special. Projects 

Southwest Educational Development Labor^itory 
211 East 7 J- St. 
Austin, Texas 78701 

Dear Dr' Evaa.s : 



Thank you for the opportunity to respond to the Ob:7e rvat iona 1 
CheckllL' ts foj Referral . The manual is well done and you and 
your staff are to be> cotiL^iended for doin^: well with a difficult 
task. 

I have attached my responstjs to the specific areas you requested. 
If you have any questions concerning my suggestions, or if you 
need additional clar if ica t: ion of any cor.rr.ents, please do not 
hesitate to contact me. 

Thank you again for letting me participate in this project. 

Sincerely, 



Mary Lovey Wood, Ph. D, 
Co-Director 



Enclosure: respon:--:es to OCR 
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ArsiTN Sim:i:ch. LANc;rA(;r:. and IlrAUivcJ Ckntku 

i./.NTi:itN LAN'!' L i..:ri;n "ion 
'^s:'.:. HANI o( K Din vi: 
Al'S'l IN. TVrXAS 7s7:i 1 
'i Ki.i.rMfJ.-; K. 4r. I : 

PA'II'.KIA I (Hi:. MA.. . (>■ l>i 111 ( I <. I 
SfAI^'i" I f».'l.V WfUH), M.v\,. I (:-J>': > . 



Kc»ci puu s* 'S to 0 (! K 

1. Mod i r ) rat: Ions to the ins f rno t i onn 1 in/inu'il 

The D-inii-il .seems rc'liblf ."or su^.po r t: j v. ■ pe r iujir.i'.' 1 and day care 
t eaclu- rs . 

1 1: n i. ^^,h t b e b e u o 1 i c i a 1 to c lu [) h a s 1 z • the fact that h: n o e d to c ni a r 
a child witli himself ^'M different a^^ports f behavior, just as v;e 
conipare him to other children. If a cliild doL'S very v;ell In some 
areas, such as drawings coloring;, et.c.5 and just getr^ by in other 
areas, .such as li.stonin^; t.:; instructions, talki^^j.;, etc., he mi^dit 
be a >;ood candiilatc' for referral. 

Anoth. area of emphasis for the tea'-^hers rii^;r:t: be that a child 
with prolyl ems in caie area is hij:;)i rLsi: for problems in another area. 
For example^, a languaj^.c:-- inipc- i red child ni>:ht also present behavior 
probb-ms: or, behavior problems might be a signal of learning problems. 

The difficulties with over- and under-rof errai\ are inevitable, but 
some of the problems might be alleviated by deling away with the forced- 
choice response required of the toacbors. Instead of allowing a 
teacher one chance t.o decide; about a child, perhaps some of the check- 
lists sliould include, a (?) categ^ ry, whe^rj the teacher can note a 
behavior about which she is not pleased. The teacher could be allowed 
a two-month grace period for cons i de ^"at i on of the child ai^d his be- 
havior. At the end of this time, she must re-mark the check-list to 
indicate problem / no problem. This would be r.pplicable particularly 
to S]iani sh-speaking children who would improve in functioning, after 
a few mv)nt:hs structure and st imul.at: Ion . 

2 . S u f .s t i o n for Ge n e r a 1 Che c k 1 i s t 

Chang/' /■ 9 to re.ad: b(n'snM always ac^t as thoug.h he b-;:rs. 
Add some or nil of tb'' ..ol lowin;-, items to pick up 1 anguage/ 1 ear n i ng 
d i sordc^ rs : 

a . Doesn ' t follow di rcic t ions ; may 1 ook to see what other rb L 1 d ren 
are doi ng, to fin ; " out What be should do . 

]^. Gives incomplete or wrong answers to ciuesrioir". hi' sluaild under- 
stand . 

r . May ec.iio or repeat quests ions. 

a. Doefu't learn to lise crayons and scissors aft'-r frv/ wecd^s practice 
e. Needs r->:tra. time and help from teacher. 
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Reponscj-, , c:un ' t: . p . 2 



f. Teacher h.is n eoncurn abi-nt ..hiid wbLcli is not euveroci 

in Lliis clu': klist. ( df^s - r i be _ ) 

c;. TunclierVs c.oncc.vw remains ^ifct-r two rionths of .school, 
h. Child's hehavi.oT c-h:ui;;L'.s af:.r ahseiieo f rom sci:ool . 

. Su>',\;c'St: i ons Tot- l^j^O'' i f i Cn».'rk 1 i s t: 

V i s i (-11 

(to be atbled t ch.-rkl i s; L ) 

a. Turns book .sid^'Ways or u : JL---dov;n to look at it. 

Iloarinf; 

(to bo pointed owl to teachurs and oLh(-r observer?;) 
Jf child is referred for h-jr.rin?. test:in^>, and nasses 
hearing sereeninf^, he n-y :u-ed to roreive speech/ Iangua^;t! 
evaluation.'^" 

b. A child v;ho has dlfficnUy learnln- to talk yr^/iy act l/i^'e 
a hear ing- imp a i red ch i 1 d . 

c. A child with hearing probl-m.^ as we' 1 a j lan.-rca-e problens 
riny exhibit behavioral clr::rv:'S after a abst-ncc fmm sck;Oo1 . 

d. Thc> hearing-irapaired child's classrocni \)]accmor;t should hv 
dict.ated by the- typu of b;.s and nmpl i f icat ion he has, and 
sea.tinp, directly in from .-^f the t rather may not always be 
i nd i c:a ted . 

^•TtK' 19:. over-referral to heariin; screening may have resulted from 
the referral of 1 an^^ srco i ^^M) i i f ' • ^ chil^lr.-n for hearinj^ testiny^ instead of 
1 anj;na.p.i.- ova Inat ion . 

Speech 

Mypersonal bias is reflected in i::y ?uj;^>!Stlon to change this section 
to Speech./Lan'.;uage. would prefer thr:t the teachers attention be redirected 
from articulation err rr. to errors in s-ntence con r; t rue t ion , grammar, 
memory for instructio.s and cotnprehens of speech. Unless t^ oung child 
is hard to understan-^ minor mi sa r t i cul a t ions should be overlo. .:d until othc' 
aspects of language .;:id learning are c-:isidered. 

Sugg.estions for CTiecklist (Speech/Language) 

.. a. Uses incop,.letc. s<M^t-ac. s (talks like a telegram) "Me go now", 
"D<uld^. eat cookie: homf." 

b. Does not sei^m t(^ a^d^'rst::-d ccmipl. - directions withcuii visual 
c I nr'S . 

c. S])an i sh-i:ng,Vi rdi cdiecklist for Speecb/kang,uar,o 

')()es not imi)i-nve in use Knglish in the conrs- of the year. 

(P. 28 ] -ovides a nice discussion of the b i-1 ii^iv'^^"^ child».. 
language problems, but sh.ould include a statc-nkut that in the 
course of the year his knglish skills should be expanding.) 

7A 
g t 



Rcspc isos , con ' t: . p . 3 



Su^',);t'5U ions [ov sp*:.'.-!) / ] .-m cm ci ^^,r clu.-^-k] ist^ccnl 



^ Any f)r Uic ilL'niL: 1 .sM,i',,;:'oslufl for rh'.' Cruy'ni] Cim.m ■ h 1 i s t: v.-hich 



Snj>i;L'St ions for IW'h;i v i n ivi i C:;il'C 1-: 1 i s (, i ip- 1 i n^ f i , wi^, 

/'"\ 

/ \ The fuacher,^^ sliou.ld he. r.rulo nvnto fhcit bchaviur problems r.riy ho 
re]at|od to learning', disoTckos. If a child d^'Oh^ not understand what is 
said \o him, or cannot oxprosi. himself, ho noy r:-.ur. viih disruptive, 
aggressivo behavior - or lu> may withdraw, J'-cdia'^ i in a ] problo:::s arc rarely 
isolated from other prc^blens. A child with Icsirnin^; r] i ^; -ibYH-H-r?^" r w fiid 
il difficult to adJiKst lo <'iny n.';v sLtnai i.^n^ and rnav U.-w-.: lror.h]\ re- 
ad jnstinr; after an .-ibsi'iire fruin ^.chool . \ 

( 

Motor 

On p. Al, yoM hav.' indicated that a child vkii r:iotor prcdjlt/nis should 
bo referred to a pedi a I r i.r i . I su^.v/'st tpit ytni add Psychol i st and 
OccupatLonal Tlu>rapist toliiis list. It is not rec.'S-arily true lliat an OTR 
(Occup<it ic^nal Therapist ) works mnjer me suporvi.sion of n i-k n- s i Lan (p.A'^>), 
a:id this ]HM-son iiii^liL piek up (^n problvM.-; wfiich a piiysic-ian i:: M',h t not hn 
t r" a i n e d to r o c o ; \ n i /- e . 

l'\'r M^Otcn- (!h<'cd:l i t 

a. 5;v/ileiirs bacdr: (d-;--; n^I use hanrl i:s)! than ih- otlu. r). 



^+ . I'he prevlcnns su[;j.',es t. i on for aLlovMiu; t r.-;clK-t a 1 et ' s~v.m i t -and-see , 

or J !in-not->s\ire ajj; roacii rni;.3ht oliinii^ate soi;to over - undo r-r of or ra 1 s . 
Also prc^viously snnj^^st^d is thr empliasis iha: a child v;ho acts like 
has on(,' probleni r^iiv have problems in mii-T (^m anotib.-r) areas. 

5. 1 am vt-ry i i:ip n ■: a-;od w i.t h OCK and \vith t!;i' exception of those svi>;',Kes t. i ^nr 

I ve listed, 1 have no clian^.^L-s . 1 vunld like a rdia.n.c^e t .--ee the f(.Ml(^w- 
u'p study after this has be-n in rffe^t for a year. 

I fool that the teardu-rs and airless vm 1 1 need I r ^ ni n?; a :i (disorvinn .'lad 
notin^T lu'haviors without I'lakin- j ud i^cien t s' t-r eva 1 ua t i r-,:ic- . '[]^^. tendency 
^■■•ith some teacdu'rs is to sa.v "AH thal^-. v.'ron;.' with h i \ i r-^ thai he's 
j'rac t i cl' (and feedbark f r< c.i vour lU a f f ab-uif" f la- re>'rra!!'. ) ^;hoi:'). r:']'-^ 
this a very vali.able tool i'or eorinii n i oa I i oii v; i ! n r' ^"o f r'ss i -.na 1 5; . 

b . No a d d i ( i o n a. 1 co ir.v. cn \ : \ . 
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In j:;ho bib 1 i o;:;r-;iphy , yv^n in i ^^ii t _ add th'j ArK>ri.ean (\' • uVa t V Mai 'IdierapY A^.s.j- 
ciati.(*>n, V/ash i na,t on , !) . C . , . and r;c:n t ra 1 instituia* for tin- Doaf in St 1/ .u i , 
VA r=;r:ou r i . 
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Rc'view of the OBSKKVAT JONAL CHKCKLl S J"S FOR REFi'.RKAL 
by Lind-i L. -^olts , Plul). 



Su;;c;e.s t ions for mod 1 f i c a I. i ons tu the 1 t r uc t i c^na 1 liinniial : 
I ' i\ c. 2 - - S e c c ovMW c i \ L s J 1 1 iii :\ n lu - 1 . 

Ir.gv* / (paragraph 1) Unch?rlir.e cr italicize to ■•. 'v. eii'Dhasis: "Tho 

Ciencral Check Lis t should b i.;-)leted Tor all. 
children in your clar.s," 

i\'r;e 9 — (paragraph j) ~- Ad' -i hricC d;'Scrptioii of imi^'.': , ^ and ringwunn. 

17 — (j iiuis This sentence is coiif using, sir- ■.■ \ . ill out 

the Specific Check 1 ist in the f i -.^i place , the 
teacher wou i d liave to clieck one ' ..o of the 
visual beha^ ^'or items (i.e., the oner-. aT:pcaring 
on the C'Qv.c:r^l Checklist) . 

Su^,^V'St del er in;^ "onl v" an.d ^hangi "none" to 
"fev;." 

Va.^L! 21 (paraj-'^raid) 2) - Sn^;,gest cha'-iui'nK sentence 3 to: 'M/.-equent colds 

a. 1 1 d a 1 1 e r y, ,i e - r e 1 . a 1 t h p r o b 1 en; s . . , ] o s s . " 



a;^e 



(linc^ 1) — JncUrie a brief def'ntion of "nasality.'' 



0 
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l'ai;e 28 (paragrcqdi "0 - Chai^.gc sent er. jo 1 lo: vefemnc the 

hi lingua I (■ b: i ] d . . . h ; 1 ingua i . *' 

I'.i^e 29 (paragiapli 1) - See the additions in i:ian-ai. 

Additio. -l sis^gostiov^s for dealing wi^h the 
nonf luerit .:hild : 

DO NOT FINISH Till' CHILh-'S S:-,MI-:NCK I' HIN WHd:' 

HI- }iKSlTAT::S. 

00 Nt'T INSIST THAT HK SPi-AK IF HE IS CRYING 

OR IS OTiiFRWISK OH\'iOUShY UPSFT. 

la;:e 37 -~ (paragrapbi A) ~ These 'ch'^f in i tions of social v;crkei- , vpsycho] og i , 

and psych ia tr ist 1 eave same thing tc be desi red , 
perhapvs because of tiie vagueness (but irtplied 
spec i f i c i ty ) of tlie terms "nenta 1 , " emo t ional , " 
arid "r^ur vous . " It sounds as tliough they each 
treat .^iffervut sorts of problems. In actuality, 
tlieve if, much overlap ]ietw(?en tbte threc^ discipline 
i n t e r it. s of the sorts of p r o b 1 e ii? s 1 1 1 e y d c- a 1 v; i t h 
and th > kinds of teclniiqvir's tliey use* to deal with 
the pro])le::a^. Perlipas this point sliould be men- 
tioned, alnr::; witli the definitions. ; I 
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'1~ 1 \ c ^ l]\r V e d i s c. i p .1 1 n c f c q i , • ' n L 1 y wc' r k i. n : 1 c i s e 
assoc; iai i.L-n witli each otiluM'. ?n gene ml, eac "i 
c! i sc i p.l i nc* brings to the ivjrsoii \v*iLh "ouioLiona L" 
])LohJc'ms a pcM'specLlve wliLch is soricv.-h.'.tL uif - 
fercnl fro;n t:he o t.hcr ..d L sc i.pl i ne5-^ , due t'o dif- 
ferent: emphases in llieir Lralning, 'i'he p'jycliia- 
Ifisl: has medical training,; liie psycliulogist bar. 
hern trained to adrn In i sr.C'; and interpret prycho . cjg- 
i c a I tests; the s o c i a 1 v; j r ke i" lias received t r a ' n i n y\ 
v/h icii ein[)has i y.o.s see ial and la.ini ly syst.eiiu^ an.-' 
sucial l:ietterment programs. But in general, they 
all counseling or psychL'therar-y (depending on 
v;)iat degree the professlrnal holds!) 



:ipcc ! : i'-. srg,gL-5; t i.on s i'or adLlitions and/tir the i et lo:*.; t:o i h'.'' (-eneral Cdieek'ir'' v.dwch 
v.'ou'-: pi'ovifde for iiu^^'e. rn-euT'-'te reftMrral to th-,- a?i:'ropriate !-h)ec:iric Ciliee k 1 i st: . 

1. r- ' "I'ixt rc-nel y restUifis .ill th-- tiKu.-; eannoL s-"..;:i ti ^tay :. c 1 1 1 . " 

Sug-.est adding K ( Boh/; v i o ra 1 CluTkli^it; as ape r .:pr i a to Speeific Caio.-k- 
j L:;r \. o (:c>ni pi e te , 

adiding an i t:eiu v;Ii:eli would dv^coci. t.vp- L'piN.'psy v!i''^]i a.: o 

accompanied hy { n 1 k-h 1 ru-.T. coiicul lo;:.^- . 

r-.'r e>:a::ipi(;: "Staring ^^p^']ls, h(^v.'\'er hri'M", c'ni'Mig winrJi no cn-e o.ir g,.'* 
hi 5; at t en* i on . " 




3. SpeciMc suggc:-^;t i.ons foi- a.dditions and/or doletitnis In tlie Speo.ifJc Cdieck 1 \ r. L ^i 
v;hich v;euld enh.<ince lIjc prohahility of accurate i d. i i [ i ca t i on of children 
iiav i ng d i f i cn I y , 

1. SuggC:;: adding an item t.o tletect poss'*k'. sei:-'!ia'S (s-.-e C.Uiostion 2 a »vv---" 
iindei- H'jalth or.. }-je]iavi(U- : 1 Cd)e(d^ 1 i s t . ) 

1. v.. I^eliavioral Cdieoklis! 

Surn'os* t'iie. i"ollov;in^' add it i-^nf;: 

a. Is ext rt-me iV^ac t i ve ; ah.'ays iia^: to he movin;; 

h . S e ems ii na h 1 e t C) s t' o ] ) an act i v i t y o n ■:: he he. s t a r I c ci it ( p r o serve* i : • \: 

p 1 ay } .s d ] ! '/en ) . > 
c. I'hc- v;ay h.c: heliaves (diap.gcT. a lot i i-o::; on*"' d:a.y to t t'O nr-xt (h ks p,o(v! 

chi y'j a n :-l ha d d a y s. are e :•: I r eii; . ) 
0. Ills atL».uition goes ra])id]y f ro::i on-:' thie.', to anc^:i:'m'; d^^es n<ii p,iy 

attent Lon to any odc. learning actmvlty i ' o' m.ma' tli.;;: 'h) Y-'-'^"^'--h; at 

a t i m-* . 

e. (^ther unusual or c:y. t reiue behav ior _ 

'i . F. Mntc3]* Cdi(»ckl ist 

Su.-gest adding: Unusual drotvlinp, . O i 
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Ar:v sug^v's: i.-.-ii . v;hic.h ni^Mil serve to lii.iL Lho ovcv- and inulor-ref erral rale-. 

\\ l.ViK' CeiiLM ■ ("ii''^.. k 1 s L is actual jy co-.v/ 1 ot c^i cin <::vcry chiid in Lho claiir^, 
.ts the ('«".^'v in.niu.' 1 • isLnicts, ih^tn ihc uw^cv-ccici'viiL rate would probably bo 
;:: i 1 i: 1, . \\\ j-raclico, i siispocL that ba^.y Voacliors will fill out chcckl isLs 
»:-.;:.y oi: ch llciron wb:'.;n they already svo a.-, ha.v Lng difriculty, rather than 
...ire."r-iv o*)Servini; each child in 'jrdcM- to complete the Gv""ae!"al Ch-; vlist on 

T: tr-Mvir:/, ha: the? tcaehfM's; receive (rr don't receive) in us In^ thc^ OCR 
^'oald r;.c' l:-' . a significant difference h\ w:. ether tliey use the cliocklists 
. . p r e p r . a l e 1 y o r r c 1. y i n s t end on v; 1 1 a t v e r s ub j c c t i v e c r i 1 1 ■ r j a t he y happen t o 
use to: .b.-ti': t.in^^ probleniF;. Kven if Lhey only received traip.ing on the 
Gene; • C] leo].-. 1. Is t Llei.ns they nii^',ht rece:::! i;:e more children with potential 
proble:::.s than they would c>tbej-wlse -~ jv.st by having tlie iler^s called to 
t he i r a 1 : en t i ; .a . 

.■\ V, enere. : sie * '^rient o!. yiMj:' asr-iessr-.-rait ^ : specific parts of OCR and of the 

r^:.' a so re as v;]iL)le. 

As a result, tu" c(mi su I t a. t i on v/ith va.riia:s presclioois in tiie Austin area, 1 see 
a. lief in it'' need for a iviea.surc* such as the f^CR which can be usee! by teachers 
:e id..:i^i* ify cliildrcui \;ho could benefit ivo^yi special help before they begin to 
fcii.] in Si.'hool. It is ImpLH-tan.t , of couivse, to do this v;itbcait tlio stigma of 
labels, wh.ich the OCR snrcessfully ::..jnac,cs to avoid. 

The inf oi"::m^ ion en the chechilsts should be useful and relevant to the pro- 
fcssion-jl.s to wh^Mi^ the teachers are T'efevving children. Also, the ciiecklist 
fr-tanat ]novides significant inf orrm t i cu: quickly an.i is more likely to be read 
fjv bu.sy professionals tluan lengthy \;ri.tLer^. reports. 

The id.eas in the OCR seeir: to have been carefully tliought out, with, the important 
naints er.ipbasized and repeated throughca:. There is sufficient detail on the 
checklists to be heli^fal but not s inuch detail that the teacher trying to 
f 111 t h em o u t w i 1 1 b e n v e r wl i e 1 ir. e d . 

Th-- instruct] as for eac-.h ch^.-k 1 i s t do an adf^qua.te job (^f explaining the 
various areas covered in tiie check! i>-t, se that any confusion arising over 
specific items would usually be clarif^'ed by referring, to tiie instructions. 
In gener. 1, :iic» ite::!S sc^.lected for eacln specific checklist do a good job of 
c>.^-.'e r itiv^ the pei'tinent beliaviors or syi::? a:iis for that prt^blein area. 

■a she!-; , ti'io (Hd-l see;:is lo lie to h i"a 1 r . ',■ ^'K' i : ool isheci in its present for;:]. 

■i.--r fv. ilea ion of the L:i.ari:y aiid i'lvu: ::h i 1 i Ly of the i;:anu.:l as a \;hole. 

;;:'n the exempt i(ni of . ew lainor caan^^-^ which 1 hav(> already indicated, tlie 
T'.anual ;--c-;;is easv tc^ re^ul and end e r . ; i a a : . Vne consistent forixat followed in 



u.;.; n see * : on he I p^: 



r '-'aciah i ki tv and the n I c tui e s h^' 1 n to clarify. 
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()C:\ vcv lew Linda C o lis 



Any addle ion.i 1 suggasf ions for ruv i.slcMi. 

! v;oi:Ui like to stress again the import anco of trainir.g in the use of the OCR 
i: Che objectives for which the OCR v;as designed iwe to be achieved. Perhaps 
a tralaing paekage could be developed for use in conjunction v.u.th the OCR. 
(For example, a short film of ciiildren in an actual classr-'.-om eould he used — 
and trainees could observe and complete the General Check! i-t on a p^^^-*'^ ^-^1 ar 
child in the film.) Training might include hov; tc^ talk to parents u- children 
v;iiO teachers v;ish to refer — This seems to he a very difficult anci couchy 
issu.^ for many teachers, and the drea.d of dealing v.-ith peirents could contribute 
■ ^ ur: Jer-ref erral . 

Tiirouriioul the OCR manual, teachers are encouraged to ask tiieir supervisors 
for help in making a referral to the appropriate professfonal person. Sep- 
plem-ntal information regarding appropriate resources for referral might bu 
inclc'ledi for supervisors aU^ng wi.th training i n forme t i on and materials. 
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OCR - JlINi: J97r> 



1. Sug/^At-'.s Lions for Mud L f ion L i on 

i foil the for soincj cxp 1 anaL i.on as on pago 7 to be given prior 

t ) najH! !). I ai"! sp^'c i fi.ca I 1 y ruftrrin^: to the specific: cliockl i s t:s code. 

and 

1 do not: liavo any rcconii.MaKia I i oi^.s fur cdian<;c' as I thou^.ht: these to be 
excel lent in their pre.;.nt: lorn. 

The measures seer.i e :cel.lenL t:o me. T would be happy to have some of 
n-.y lie Id 5'.taff (local ll.'ad Start" CvnLer people) be a part of any trial 
te.sLin;; of thoiJu checklists. It v.'cald .seem to :r.e tliat area workshops in 
states v/liere this kind of i n foriia ti on could be discussed with Head Start: 
peopU: as well as otb.er llarly C;hil'::iiood ^ iff might help in the endeavor, 
'ilie r.annal is se 1 f-e xpl ana to ry if rer^lc will carefully read. HowevcM', 
1 do believe that so-ie ty\>c v,\»rksl..'p lor staff wiio would be using these 
obsorvat iona.l chcokli^Ms would be cf value. 

5). Tlv ir;oas.uir seems excc'llent to me. I would be anxious for this to 

be us.hI in riiv program. Tnere is. without question a need for such a mc^asure. 
I particularly 1 i l.c the c^xpl ana t i o::s prior to the specific checklists. It 
api-^ea.rs tu bo written in ternis that non-professional staff could use the 
Mo::.-ures. i feel very, very i)c)SLtive tov:ard the raeasures. 

6. Hu' man;::! i vory clear ar.d L he; lev-' bo ^'r ry u'-eful by iv ^n-p ro f of; .s i.ona 1 
a.. va.l ; prof.;: I ^ i' taf f. 



J nolod Ihree cm.i'r. v/liich p rr?'-'.:' I tiavo alr.iady bacn discovered or 
at Ica.st; 1 t.hi)ut;,]H. iIilmm to he orrcM's. 
On pa^;o 7.2: 

word sc'.r (uii ddlc of I'liddlo sect, ion) 
Pa<;c 27: 

1 m <.h • r ^■. I a n I (nit d d i of f i r t P' ci r a r a ■ »h ) 
}\\[\c. 3: 

11 11 usual, c: 1 ui u i n : . ». > 1^ a wk\ / a r d nc s s ( i :; i d d I. ot .1 a s i n ; i r a r a p 1 1) 
Ap,a"in, 1 do believe s la te,\;j do or are.ns training; v.vithin slate::: '.•ould be 

'nelpfui. . I'or e:<cinii)le, T feel y>uvi' that in Ark:i[i.Sci^s tlie vStvite "^/'i'A j)rc)vides 
Ivoth StiOiKsjeh, ASA, Stale University, Ark''::s.'u^ would be ha]^py to find a 
time ffU" these nu^aiaire:; , and their :" m 1 at. ■ in ha.T'ly (iiiildhood ]'ro^;raiiis 
t o bt,^ exp la i ned . 

Ap,ain, i reviev;c-d th-e book tv/icr ai:d feel v:r}- poi;itiv..! a])Out it an.d -i 1. r. 
ust.' !"al niT.s by bot.li p ro fe ss i (ai^.l and non-pro fe.'-sion'i.l staff. 
I'nank you f'.-r asking; : to rLnaev; thi. .-.e i a ■; tru:'eut s . 
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:-::iy 1070 

To: Joy-jii Kvaiu: 

rro:?.: Joy Koyo 

K-:t : }-vOvit'v; of: ObL^t^Tvat-. i <-»n:il Checklists for K'-^ferral (OCR) . 

1. A v.jO!ic:rai t-.at' ^^KMit of your ass-ssr^.ont:. of spcci[ic parts of tho CCK aiui 
of t.ho r".'a:nn:o ar;. a whole. This includes; your asse^is.?..;!! t of the nood for 
f.j;ch a moar>ure and its usofullness in aiclin-:; t:rjachcrs rn coinroanicati.ng wich 
professionals .in providing referral inforirat ion . 

Kroin my eM[;eriep.ce of dircctirK.j a lie:; i .^tart pronra:?. in a rural area 1 
ci:- s .^iLi: ci'-phatically that there is a nc:ed ::o heli) teachers recognize the 
inr-wr t:ance' of obsorvinq individual children and conir,un icate ti; ■ appropriate 
infor:Ti.aLion to professionals. Rural progr'a:' s have t'vso distinct problems 

1. e. . .Tion-cortif icd or forir.ally train'-'i staff and a lack of resources such 
as diagnostic clinicS; pediatricians, psych: logi^its , etc. To cornloat tiiesc 
rrobU.ms, st"ps :;aist be taken to train staff, since it is almost i.mpossiblc 
to provide r-Mic^U-^ces . Teachers, being in close contact vith the children, 
can be trained to --^>)serve and be of re:il service as referral cigents. Edu- 
cation is fast' bec-oming an rnstit.ution of stecialists, which in urban areas 
relieves toach.ors from needing to be vare of handicap-ping conditions, 
iicwever , in rural areas, tc^ach.-rs nu£;t not r-nly be aware of these condition 
but must also be abl^ to oL.:erve children ar.d their behaviors so that tliey 
can be a}K->ropri alel y referred to lu-of ess ionals . 

2. Your evcilual-.ion of tlie clarity ar.d rrs'id fsility of tVie me.nual as a whole 

The manual i fairly clear and readabl'- however, T believe soiae change 
couLd be ma.de \n thr- f.>rmi- t.hit v;ould m. it c^as, lor to read. Firs'.. I 
would devote a portion of the first part of thc^ manual t'> th.e proce-^s, of 
re f o r r a 1 . Vo r ins t a ir a ' : 
O 1. V/l^o ob.scr.ves? Tcaclior, aide, health worker, (itc. 
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2. To whom is reforral inadci? Head toachrjr, c:ep.t.:;r Director, Social 
'Worker, Procjram Dirocl:or, Professionals. 

3. v;ho informs parent? Teacher, other staff, professionals. 
V/ho completes the follow-up process? Teach. -r, other staff. 

Every program has its own procedure and teachers siKuild not only be aware 
of th'j proceduru but should follow it step by step. Tf teachers are to refer 
directly to professional, the manual becomes more important. By including 
thi::- information in the front of the manual, needless repetition can be avoid- 
ed in the instructions that accompany the sijccific checklists. 

Secondly, a page of terms and definitions could be included in the begin- 
ning rKtheV than cluttering the instructions all the way through. 

Thirdly, the specific checklists couh'' lie identiiied on the Gen^iral Check- 
list rather than letters to help tc'cichers choose tlie a.: :>ropriate specific checic- 
list- . 

3. Suqqestions; for modifications t:o tiie instructioiial manual. 

J woula h'-sitate to hand t:his Kianual to a teacher to use withruit oth^*r 
trai::in'j. Prt>-service training coi:.ld include skits, vj:;uah^;, role playincj, and 
ot:;-:r motn.ods of pre: practiei' and .lualicjns wherv t-' j.c:h' tr:^ ecnild gain some 
confidence l.-foru act sally ur^ifig the manual- 

T'.'ace.ers- not beinc{ pr^:>par<-d t;:. fore \isinq the manu.il in tdic: Cir.^it review, 
coul-'i eX'-'lain so:r,e of [.he. pruL^lem.^ of ov-.-r and n!?di.i:r r^-ferral. Con f id'-'uce and 
ti\'-t ii} one-' - o*ai iuuM;miMiC can lielp •..'■achc-rs oljserve ir.ore c: f fee': i v- ly , and 
c^n f i. d^'inc-:- is a^.^:[ui>^•d afi.,er svb^c-ss is at.taiswd. 

A, Seecific sufjgest ic^ns '^-'i: addition^: and/r^>- d-l-:;ic.ss to th-- C-v-n-ral C'.-ck- 
list: which v;oa Id prcjvi.u; for lu )re Ki':cur.x'. ?:'r-e;rjl t^-* th'/ api >: ^^..^ri a te ^'^pecifi 
Ch'-ckli 

It- t.i;:]i:n'_-nt-. ^- 1 . ■ 

5. S:.--::ii.ic suggc>r; t: ions for additi.Cins and/c^; a l.:'-io:'S in llr.' S] eel tic Ch-^:!;- 
list.s v:hich v;ould enhance the ])roha:j.i 1 i ty of acorai/-' i d^^nt:i f i cr. ^ ion of child- 
^ ren having difficulty. []*^ 
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SCO attachments 2,3,4. 
G. Any suggos tions which niicjht servo to lin.lt the over- and undcr-ref orral 
rate , 

High over and under roforral rates can be the result of teachers lack 
of confidonco in their ability which would cause them to he over-::ealoas and 
over refer or afraid to trust: their ov;n judgement and under refer. 

Another caur^e might be the time element. If the checklists are completed 
early in the program, children and teachers are both in a transition period 
when a true picture cannot be seen. Some children may exhibit behavior that 
v/ould indicate a problem when the only problem is that children have had no 
oxperioncu in tb.at ])artxcular area. v;heu teachers note a problem, they should 
provide activities i-nat v/ill give children experience in ^ihat aro.H, and then 
consider tive lack of skills for the clvjcklist. 
7. /\ny eiddi t.i ona.l suggestion.^', for revision. 

The (OCR) .lacks a section on parents rights and tk.e confidentiality 
law.^. 1 feel strongly that parents are the first p-rrso^L to consider in 
makin.] referrals and the manual is weak in this area. f-urthcr, no mention 
is made in fn.e manuals of the existing ] av;s ccnce rriing cc-n f idontiali ty . 
x-.'a::hers must be n.ade awaro tliat any informac.icn they lecord can be seen by 
parents at any time request is made. Further, the records must be kept 
confidential so thtit t' jy are not avail ::>le Lo unauthorized perr.;onne] or 
c e : 1 1 'i' r v i ^; 1 1 or s , 
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FKKDKACK FORM 
OBSI'KVATIONAI. CilECiaJSTS FOR REFERRAL (OCR; 



Torvclicrs * Name; 



CcMUor or School 



City 



Number of Children in Class jlexican American 

Anglo Other (Specify)^ 



Black 



Nunber of children receiving at least one check on 



General Checklist^ 
Hearing; Clieckl is t_ 
No tor Checklist 



Health Cliecklist^ 
Speech Check] ist_ 
Vi s ion Checklist 



S o c i a 1 / Emo t i o n a ] 
Checklist 



Nunber of children referred for follow up services on the basis of the OCR_ 



IMcase rate the checklistr> and the manual on the ft^ lowinc^ scale: 

Excellent Good Avera|^(^ Voor Useless 
CHECKLISTS 



Gejie rjA !_ Chji cj<. l_Ls t 

He alth C h eckli st 

Visi on Ch eck_lis;^t 

Hearing Checkl ist 

Sp e e c h Check list 

ghavio r Checklist 

Motor Checklist 

Ease of Administration 



yANlIAL 

1 n tr o_d u c tory _C_1 ui_p_t e r_ 
Health Chapter 

— -2-^— - 

Hearing Chjiptgr 

^_E£^^"^_?il^i£^-:I 

Behav ior Chapter 

Mot or Chapter 

Referral Sections 
(Were sections on 
pa^'^es 11^, 1_7, 22^, 
28, _37, 4 3 helpful ?) 
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General Reliability: 
(Was the manual easy to 
read and understand?) 



EKLC 



Illustrations: 

a. lielp toward under- 
standing the text: 



b. Contribution toward 
manual format: 



Organization : 
(Was tlie manual clearly 
organized?) 



Suggestions for change in cither cJiecklists or chapters; 
1. General 



Heal til 



3. Vision 
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4. ilearir.: 



5. Speech 



6. Social /KiiKitiional 



7. Mfitior 



V.'hich secti.lonCs) was (wcm-c) nK>L;L iinporLaiU to you 



Which stv.Lion(s) was (wore) least import auL to you; 



Wh 



at other tests have you nsed to screen children for re terra 1.? 



What did vuu lil;e heat ahonl tlio waruial? 
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What did you like least about the manual? 



Wh:it did you like best about the checklists? 



V.'hat did you like lea,st about the checklists? 



What is your overall opinion of the 0C:<? 



EKLC 



Would vou recommend the- OCR to other teachers? 



Please indicate if the following tests are done in your school or c *-er, when, 
and by whom: 

U^ien (Fall/Sprinr' 
Every year or ev^ - 

other year By Whom (title) 



Vision S creening 

Speech Scree ning 



Emotional Screenim 



Psychological Exam 
(S tanf or d-Binet Type ) 

Medical Exam 




Other comments: \(Use back of page if necessary) 
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CONSULTANT MEDICAL TOYC-l 
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HKiGUT 

Tn . OR cm'. 



pkrckntim: 



DOES THE K>L'\M REVEAL 
AUY AKXOR>LvLlTY iri: 



CeS UlAL APPEAR^VN CE , 

i^^'ti^.lL?---^-!? 

SPEECH 



SKIN 



EYES: EXTERN/\J.S_ 



PHYS_lC;i\ L E}0\M _INA;riON 
WEIGHT 



LB. OR KG. 



A 
B 
K 
0 
R 
M 
A 
L 



OPTIC FIND 



?:ARS: EXTERNAL AND 
CA^NALS 1 TMI>ANIC ME ^BIiLAN]^^ 

Nos^,_jpjnj 

TEETH 

HEART 



LUNGS 



ABDOMEN (INCLUDE HEIUmS)^ 
GENITALIA 



BONES, JO INTS^IlJSCLES_ 
OTHER 



N 
0 
R 
M 
A 
L 



PERCENTILE 



AC 


}^ 


' YR. 


NO. 



BLOOD PRESSURE 



N f: 

0 A 

T A 

I 
N 
E 
D 



DESCRIBE FUT.LY ANY 
ABNORi'IAL FINDINGS 



■'dEVEL0P>D:NTA1. SCREE:aNG_^XAMINATION 



GROSS MOTO R J^CjriQN__ 

FINE MOTOR & MANIPULATIVE 
FUNCTIONS 



ADAPTIVE FUTsXTION 



LANGUAGE FUNCTION 



PERSONAL - SOCIAL FUNCI^ON^ 



NORM-\L 



OTHER 



REMARKS 



SUi¥lARY^^^ TREAT>n:::TS , AND RECOmENDATIONS 



abnorM'al findings 



ADVICE AND 
TREATOENT GIVEN 




KJiCOMI-PENDATIONS OR FURTHER 
EVALUATION, TREATMENT OR 
SOCIAL OR EDUCATIONAL SERVICES 



ERLC 
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r-T /-.MAT tine r»W PUVClTr.TAN: 



DATE: 



APPENDIX F 
CONSUJ/rANT SPEECH FOICI 
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SPEECH 

AGK: 

ARTIC (a) errors: 

(b) lnLo.1 liglblli ty : 

FLUKNCY 



AND LANGUAGE SCRKKlvIING 

EXAiMINKR: 
DATE: 



ORAL MECHANISM 

LANGUAGE 

basic info. 
\ih — qucs. 
syntax 
vocabulary 
memory 

MOTOR 
RATING 



Compre?iGnsion 



Expre 



_no problem 
_possible problem 
__high risk 
^definite probler.: 



BEHAVIOR 
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